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ABSTRACT 


The purpose of this thesis is to study and enhance an automatic image feature 
analvsis system for aerial photographs in order to detect changes with respect to a 
model defined in a knowledge-base. The system interpretation must resemble some 
intelligent human interpretation and by its use should be able to reduce the manual 
effort in processing large volumes of data. 

This computerized rule-based system is integrated by using Prolog and Image 
processing Operators, which run in a multiprocess environment and communicate 
through a blackboard storage. The Prolog expert provides the model through a 
collection of certainty rules and facts, and uses its “inference engine” capability to 
combine different measurements. They are obtained as the evidence necessary to 
deduce a conclusion about the condition of a feature. 

The system must be able to deal with uncertainties generated Os mO S E TE 
images, variability of imaging conditions, and possible errors in the model. The main 
task is the formulation of interpretation rules so that the expert system can mimic the 
“reasoning” effectively from the domain principles and yield high confidence results. 

A system that satisfies some of the stated specifications has already been 
developed by Prof. Chin-Hwa Lee and Hsi-Jian Lee. This thesis as the continuation of 
the investigation process addresses the following objectives: 

l. Analvze in-depth all the Fortran programs in order to detect possible errors in 
the Image Processing operators (The main modules are: Shadow Processing, 


Model suided Split and Merge, Region Selection and Model Projection): 
additionally the documentation of all the programs should be generated. 
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Expand the Rule Data base and Facts Data base to enhance the actual 
capabilities of the expert interpretation svstem. 
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Veasure the CPU time for each of the subprocesses in order to determinogie 
time consunung parts of the svstem. New approaches to improve those parts 
should be considered and developed. 


4. Apply the svstem to different kinds of images to evaluate the system response 
to several illununation conditions and different image detail. 


in 


Develop and Incorporate reflectance modelling capabilities to make the system 
more accurate. 
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I. INTRODUCTION 


A. THE BACKGROUND 

To have automatic image feature analysis capabilities over an aerial photograph, 
involves locating and studying specific objects. In this analysis, locating buildings and 
detecting changes in their structure is the objective. These are difficult tasks because of 
the variability in image conditions such as weather. time and attitude when the 
photograph was taken. Other possible reasons are the introduction of noise in the 
digitized image, errors in the ‘model’ used to match the observations, and errors in the 
results generated by the Change Detection process itself. 

There have been several approaches to generate model-based image 
interpretation systems, see (Refs. 1,2,3). These efforts have tended to concentrate on 
high-level issues such as three dimensional object representation and matching. Others 
have been involved in aerial photograph analysis, see (Refs. 4.5.6). The need to have 
automatic image interpretation systems is related directly to the large number of 
images obtained from satellites and intelligence sources. Updating the information 
provided by these photographs requires the employment of human resources and time 
to analyze, detect and identify changes in existing buildings or to establish the creation 
of new ones. Because this process doesn't guarantee its results to be free of errors, it is 
time consuming and takes large amounts of human resources. Consequently the use of 
an automatic Image Interpretation System Is justified. 

If an Expert System could be created to perform automatically the image feature 
interpretation, the same process could also be used to identifv other specified features. 
Its principles could be applied to a wider number of applications like the development 
of artificial vision systems. The system developed by Dr. Chin-Hwa Lee and ASC 
Lee actually satisfv the main objectives of this investigation. The thesis effort should 
be oriented to continue the implementation of new capabilities and to make this system 
more cfficient in terms of execution speed and memory usage. Toota 
objectives, 1s necessary to review the software in detail and obtain a better 
understanding of how the systein works in order to point out the possible areas of 
enhancement. The work to be done here will be considered as the necessary SCS 


better and more sophisticated method of image interpretation. 


The contents of this thesis include: 


Chapter I: A brief description of the problem and advantages of using expert systems 


for the implementation of the Image Interpretation. 


Chapter II : A description of how an expert system could be created to perform the 


required objectives, also has a general overview of the actual system structure. 


Chapter III : Some concepts on photogrammetry. This background is required for 


studying the svstem, because the analysis is done on aerial photographs. 


Chapter IV : Shows the work done through the development of this thesis and includes 


details on the execution of predetermined tasks. 


Chapter V : Gives the conclusions obtained after working with the Image 


Interpretation System. 


B. EXPERT SYSTEM IMPLEMENTATION 

Expert systems are computer programs that emulate the behavior of human 
experts in a specified domain of knowledge, they use knowledge and inference 
procedures to solve problems that are difficult enough and require significant human 
expertise for their solutions, see (Ref. 7). 

Some capabilities found in the expert systems are needed to develop our image 
interpretation system as the followings: they are “evovable”, that 15, easy to modify and 
update, they also follow a top-down modular design approach where modules are used 
to hide details and through their use later changes in the design are easy to make thus 
keeping the knowledge base complete and accurate. They have the capability of both 
forward and backward reasoning. Forward chaining is a problem solving paradigm in 
Which chaining starts from a set of conditions and moves toward some conclusion. 
Backward chaining is a process that requires a goal or a hypothesis as a starting point, 
from where the process proceed ‘working backwards’ along a path to determine if the 
hypothesis is true. Improvement in the performance of the program is possible by 
constraining the search for a solution. Additionally expert systems allow uncertainties 
to be taken into account during the design of the system. 

The structure of the Image Interpretation system consists of knowledge clauses: 
rules, facts and structures; a reasoning element: deductive inference engine and control 
programs; and image processing routines: to process the image and work as the 


computational environment. 


The Knowledge base approach allows us to use the expert knowledge of the 
domain bv developing change detection rules and incorporating a-priori knowledge, see 
(Ref. 8). The Rule Base is an open ended structure which permits information to be 
added or subtracted tn an incremental manner. These are tasks performed as a 
consequence of finding mistakes in the process and improving the organization of the 
rules, see (Ref. 9). These changes must be done in the contents of the control Saus 
in an efficient manner, therefore the system must have a modular implementation to 
facilitate evolutionarv changes. The main task 1s to provide the system with the 
knowledge of expertise in the field of image interpretation, then the computer makes 
use of this knowledge, as in this system, to detect changes in buildings located in aerial 
photographs. 

Expert systems software show greater separation between data and program 
constructs. This feature is generated by providing non-procedural constructs at higher 
levels. This separation enables more flexibility in the creation and maintenance of 
software as Well as ease of understanding, see (Ref. 10). An expert system also has the 
following three characteristics that makes it convenient for our application. First. an 
expert has knowledge of the concepts relevant to the domain and can solve problems 
by reasoning from the domain principles. It is able to capture and retain expertise 
from an expert in the field, which will be used in the interpretation of the results. 
Second, because knowledge-based svstems attempt to represent expertise explicitly, the 
system makes decisions, or suggest decisions, and explain its conclusions. This explicit 
representation of symbolic structures, behavior and reasoning allows flexibility and 
adaptability as a result of the explicit declarative nature of the representation. Third, 
the knowledge representation and use are embeded in the programs control flow. In 
contrast to traditional procedural programming languages, such as Fortran and Pascal, 
that have been used previously to implement similar systems, these systems, even being 
efficient, lack transparency, modularity and flexibility. Consequently adding, deleting 


or updating the knowledge is a difficult task. 
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MeSy St EME GENERATION 


A. THE APPROACH TO SOLVE THE PROBLEM 

Analvsis of aerial photographs is a complex task. A prime cause 1s the presence 
oline texture which causes difficulties for the low level processes such as the 
segmentation routines, see (Refs. 11,4). Another source of difficulty is that the desired 
objects and structures may be too small compared to the resolution of the photograph 
see (Refs. 12,13). A detailed analysis of a complete high resolution aerial image 1s 
generallv prohibitive because of the computational costs. 

Iori tO Overcome sthe sdiiremtues in the brute force analvsis of aerial 
photographs and obtain a better description of the area under consideration, we are 
using artificial intelligence techniques. The system must emphasize a goal-directed 
approach and reasoning techniques with possibilities of using a-priori knowledge from 
the ‘model’ and data calculated from the image to achieve the determined goals. 

The approach to solve the change detection problem. demands the establishinent 
of a ‘model’ of the object, which will be used as the guide element, a Rule Base expert 
that has control structure for the Change Detection System, and Image Processing 
Operators that provide the necessary measurements required to achieve goals of the 
Frolog interpreter. 

The term ‘model’ will be used to describe the building or group of buildings that 
we are trving to verify in the image. The facts database used as the environinental 
‘model’ is a tree like structure composed of a number of nodes, where each node is 
described uniquely, see (Table 1). The environmental “model has a hierarchical 
structure where a-priori information describes in a set of facts about their individual 
properties and interrelationships. Besides the facts database, there must be several 
dynamic databases oriented to follow the development of the process and to record the 
intermediate changes being performed. 

Every node is described as a collection of related properties. It includes 
appearance knowledge in the form of object properties : predicted location. surface 
material category, children and ancestor nodes, minimum boundary rectangular, 
background SMC, and properties to be analized in this node: shadow, size and tone. 


and weights assigned to these properties. The height, number of vertices, and 
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comipactness must also be included in the node description. The facts database can 
specify different weights for the assigned properties in the nodes. Some properties are 
less reliable, conversely, other properties are considered stable and therefore given more 
weight. 

The control structure, in this case the Rule Based expert exhibit a backward 
chaining of inference as it tries to achieve a goal. The importance of this process relies 
on the rules not calling to each other. Thev communicate through the facts in the path 
to satisfy a goal, and make use of newly generated assertions. The Rule Based expert 
las relational knowledge in the form of parameterized relations between objects. It can 
adapt the more general ‘model’ to anv particular image by a reasoning like process. 
This resemble an intelligent human interpretation process. 

The system must use its rules to combine the region description attributes and 
select thresholds to modify its own results according to the image conditions. In case of 
failure, the set of rules must reason about the situation, tailor its behavior to redefine 
the analysis scheme ,and obtain better results. The system must be able to deal with 
uncertainties that may originate from the imprecise ‘model’ or from the noise data 
generated by the image processing operators. 

The Image Processing operator also provides the knowledge base with measured 
relationships obtained from the segmented image. They are: the labeled region map, 
Member of regions detected in the image, sun direction, base plane equation 
coefficients, area, perimeter, average tone and tone variance, nunimum boundarv 
rectangle and compactness. Also included are general information of the image as 
‘affine’ coefficients, exposure station, sun direction and the indicator to the 
corresponding side of the stereo pair of images being analyzed. 

The image processing operators include standard image processing routines 
Written in Fortran or Pascal languages. They consist of region segmentation 
algorithms, shadow processing, and region analvsis capabilities. The recognition of 
objects are done in several processes which are designed to detect the specific type of 
objects in a prespecified region. In this system, the image description must be 
measured automatically in the computational environment and is particular to the 
photograph being analyzed. The a-priori knowledge provides the Change Detection 
Systemi with predicted area facts, that helps to locate the area of the buildings. 

The Change Detection Svstem studies the correspondence between the image and 


the ‘model’ of the domain of interest, which in this case describe the knowledge about 
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buildings. Once the ‘model’ has been consulted by the Prolog Interpreter, the process 
can be then divided in two main parts: the first is the segmentation of the image into 
regions, where their properties are stored into the background interprocess 
conimunication area shared by all subroutines of the computational environment; the 
second part is the matching and inference process. 

A feature being analyzed may be broken into numerous region segments, see 
(Ref. 14) not necessarily matching the predicted model projections. Therefore, the 
segmentation will be crucial to the success of the system behavior and additional 
efforts will be required to refine the segmentation of the image. Here, the segmentation 
process is knowledge directed and this could decide the success or failure of the 
analysis. 

To summarize, in the Change Detection System there are threc lei 
interaction. The first being the ‘model’ is the knowledge base that provides the svstem 
with the building description, the search can be constrained according to its predicates. 
The second level, being the Rule Base Process is the one that decides which process to 
initiate to satisfv svstem goals. It is the reasoning part that tries to find the regions 
with the desired characteristics. The Rule Base process can also react to failire by 
readapting itself and trying to resatisfy its goals. Finally, the third level, which consists 
of image processing operators, examine features and performs computations on the 
image itself. 

These three elements interact and generate the evidence necessary to deduce a 
conclusion reflecting the situation of a feature. After evaluation, if the calculated 
results are different from the expected, the system reevaluates its conditions and takes 


COTrective action. 


B. HOW THE CHANGE DETECTION SYSTESXP WORKS 

After the facts database has been generated for the available buildings and the 
Rule Base expert established in the Change Detection System, the digitized aerial 
photograph 1s segmented into regions using a segmentation algorithm. The 
segmentation algorithm is provided by the Spider hbrarv: a software library that 
contains image processing Operators. The characteristics of every region to be analized 
are extracted. Now, by using the building’s predicted area location obtained from the 
facts database, its position is verified in the digitized image in order to decide wether to 


continue with the image interpretation analysis. The ‘blackboard’ interprocess 


IS 


communication area is created, and the extracted region characteristics are also read bv 
the Change Detection System to be included in the facts database. 

Now the Change Detection System generates a list of nodes as subjects of 
interest to establish the existence of the buildings and to obtain the partial evidences 
necessary to deduce a general conclusion. The nodes in the list (referenced as 
‘checkinglist’) will be activated progressively from the lowest to the upper hierarchy in 
Mae tree structure. 

The certainty value of every node is calculated by combining the weighted 
properties of the node and multiplying it with the arithmetic average of the certainty 
value from all the children nodes. If this is a terminal node, its father’s certainty 
should be updated and its descendants removed from the ‘checkinglist’. This process 
continues until all nodes have been verified. Once the certainty value of a node is 
decided, its status is reported. If the results do not yield enough confidence for the 
existence of a specified node, then the segmented image is refined by a ‘model’ guided 
split and merge process. The split and merge process uses the corresponding region 
associated with the node projection. It implies the creation of new regions related to 
the segmented areas generated by overlapping the node projection over the labeled 
region map. After the refining process, the ‘blackboard’ and the facts database are 
updated with the new region characteristics. 

The Prolog expert then repeat the process of obtaining the certainty values of the 
node according to tone, size, shape and shadow characteristics in the following ways: 

The certainty of size is obtained according to the relation of node projection area 
against the sum of the corresponding region’s area. 

The certainty of polygon uses the mapped area of the node against the sum of the 
intersecting segments in the labeled region map. 

The certainty of shadow is obtained by first obtaining the location in which to 
look for the shadow. This process uses implicit knowledge of the sun’s position as 
provided tn the common area BOARD, it then uses the image processing operators to 
obtain the tones and areas of the predicted projection shadow areas, and evaluates 
them against the ones measured from the digitized image. 

The certainty of tone also makes use of the sun’s position and image conditions 
already known to calculate the tone of the regions of different nodes. It uses the 
surface material category and surface normal to determine the amount of illumination 


reflected from the node. 
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HI. PHOTOGRAMMETRY TORC: 


The following definitions and concepts are included because thev are vital to the 
understanding of the Change Detection System. Many of the parameters discussed here 
are used in different programs and subroutines in the Change Detection System. These 


concepts have been summarized from a text in photogrammetry, see (Ref. 15). 


A. BASIC GEOMETRY OF THE PHOTOGRAPH.- CONCEPTS 
l. Orthographic versus Perspective Projection 
A map is a reproduction at reduced scale of an orthographic projection from 
the terrain onto a reference datum plane. A perspective or central projection, 1s One in 
which all points are projected onto the reference plane through one point called the 
perspective center. In photography the sensitized film occupies the reference plane 
where the negative is formed behind the perspective center, see (Fig. 3.1). 
2. Image and Object Spaces 
The photograph is a perspective projection. and the optical center of the 
camera lens is the perspective center. The region between the perspective (center miui 
the negative of the photograph 1s called the image space. The region occupied by the 
object to be photographed, including the reference coordinate system, is called the 
object space. 
3. Image Coordinates 
The plane of the photograph, which contains images of object points. 1s a 2-D 
representation of a generally 3-D object space. The X and Y axes of the photograph 
are defined by the fiducial marks, with the center of collimation called the indicated 
principal point IPP or fiducial center taken as the origin. The position of the 
perspective center will be over the IPP at a focal distance Tf. 
4. Object Coordinates 
A 3-D right handed Cartesian Coordinate System XN. Y. Z is used as references 
for the object space. If 'L’ 1s called the perspective center, then the Object COS 
of the perspective center, or better said the exposure statioi 15 NUS 
described in the PROJECT and NY21J subroutines see Appendix B and (Ref. 16). 
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including the reference coordinate systen is 
called the ’obyect space’. 


Figure 3.1 Image and object spaces. 


5. Interior Orientation 
The interior orientation of a photograph defines the form of the bundlc of 
Meseemiercing from the perspective center to the points in the ‘image’ space. It 
expresses the angular relationship between object space ravs on the basis of the 
location of the image points with respect to the perspective center. Thus the position 
of the perspective center with respect to the image coordinate svstem represents the 
geometric elements of interior orientation. being NO, YO and F, where XO and YO are 


the 2-D coordinates of the IPP. 


6. Exterior Orientation 
The exterior orientation of the photograph defines the position and orientation 
in the object space. The position of the photograph is defined by the object space 
coordinates of the perspective center XL, YL, ZL. The orientation which descr omoa 
attitude of the camera at the moment of exposure, refers to the spatial relationship 
between the object coordinate system and the image coordinate system. The system 
used here, and a very common system, defines the orientation by the orientation angles 
OMEGA, PHI. KAPPA as used in the PROJECT subroutine. 
OMEGA is the first rotation around X, counterclockwise. 
PHI is the second rotation around Y, counterclockwise. 
KAPPA is the third rotation around Z, counterclockwise. 
Thus the exterior orientation of the photograph ts defined im terms ol SE 
ZL, OMEGA, PH], andes rer 
7. Orientation Matrix 
The relationship between the image and the object coordinate svstem 1s 
expressed by a 3 x 3 orthogonal matrix where each one of its elements is a function of 
either one of the angles OMEGA, PHI, KAPPA. This matrix allows to transenne 
from the object space svstem to the image space system, that is from the real world to 
(he photograph, see (hic. 572): 
8. Collinearity Equations 
Any individual pixel in the photograph can be mapped from a 3-D object 
coordinates by use of the 3 elements of interior orientation and 6 elements of the 
exterior Orientation. which describe the collinearity equations. These 9 elementsiame 
constant for all pixel in the image, but since the photograph is a 2-D representation of 
a 3-D object, the scale is different from one pixel to another. To avoid this problem, 
We use the collinearity equations as shown in the subroutine PROJECT. 
9. Photo to Digital Image Transformation 
Transformation from the photograph coordinates to the digital image 
coordinates is called an ‘affine’ transformation and includes a rotation, two scale 


changes and two translations. This implies the solution of the equations: 


NP = SX(cos(P) - è sin(B))XI -(SY sin(B))YI + CI 
YP = SX(sin(B) + 6 cos(B)\)JXNI -(SY costs) leew 
where 

XP, YP = Photo coordinates 
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Figure 3.2 Image and object coordinate systems. 
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XI, YI = Image coordinates. 

SY, SY = Scale changes. 

Cl, C2 = Transliqnomin podoaces. 

DELTA = Nonperpendicularity or affinity between the axes X, Y. 
BETA = Rotation angle. 


This transformation is also called 6-parameter transformation. This process 


has been implemented in the subroutine NY2IJ. The following data has been provided 


for the analvsis of the aerial photographs under test: 


(a) 
(0) 
(c) 
(d) 


(e) 


Al = SXC D sin/B)) 


A2 = Ssn P + 6 cos/P)) 
Bl = -SYsin(B) 
B? = +SY¥cos/P) 


. Data provided 


Calibrated focal length for both photos in millimeters. 
Calibrated principal point for both photos in nullimeters (X and Y). 
Radial lens distortion correction for both photos. 


Digital image to photo transformations: the coefficients Al, A2, Bl, B2, Cl, 
2 in radians. 


Exterior Orientation Parameters: OMEGA, PHI, NAPPA, NCE O 
radians and meters respectivelv. 


These concepts are implemented into the subroutines PROJECTEN T REEE 


AFFIJ, these subroutines are called by the modules PTPROJ, PROJMBR. PROS 


and SELREG with the purpose of obtaining the necessary interface between the 


‘geocoordinate system and the image coordinate system. 





Ao THESIS DEVECORNIENT 


A. INTRODUCTION 

To continue the study and development of the Image Interpretation System 
created by Prof. Chin-Hwa Lee and Prof. Hsi Jian Lee, a initial learning process was 
necessary. It included Prolog programming and an Image Processing course to be 
dictated by Prof. Chin-Hwa Lee, as well as general concepts in photogrammetry and 
some experience with the use of VAN; VMS system. FORTRAN programming was 
required to work with existing programs beside using Prolog. There was also one 
program written in Pascal. 

The general orientation of the thesis was to improve the Image Interpretation 
System by reducing the CPU execution time, analyzing memorv usage, and detecting 
possible software errors that could interfere with the process of Change Detection. It 
Was suspected that some of the nodes being analvzed, were not properly detected bv 
the Rule Base. If possible, additional modelling capabilities and different approaches to 


solve existing problems could be generated as part of the system’s enhancement. 


B. SOFTWARE REVIEW 

MERA oia Stine Soli are Was imitated with the review of the FACTS 
DATABASE and the RULE BASE. This study facilitated a general understanding of 
the problem solution approach as well as providing a grasp of how the ‘model’ 
parameters interacted. 

The particular structure characteristics of the Prolog language, which include 
‘cut’ operators, variable ‘instantiations’. and a ‘backtracking’ behavior, requires a lot of 
Experience to analyze as in this case a complex system. The study of the Prolog part in 
the Image Interpretation System was more difficult than expected, additionally, the 
unavailability of source documentation at that moment made the task of reading and 
debugging more complicated. 

ii serio Proeraimeeaready created, see {Table 2). were developed in a time 
period of more than a year and half bv Prof. Chin-Hwa Lee and Prof. Hsi Jian Lee. 
Because the topic is complicated, it required several weeks to understand the ideas 
behind every FORTRAN program and subroutine. Another fact that complicated the 


process of understanding was the invocation mechanism used bv the Prolog Interpreter 
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to initiate FORTRAN modules. This requires a protocol of setting flags to indicate 
initiation and completion status. The results of the FORTRAN modules were being 
transfered back to the Prolog Interpreter by means of ‘mailbox’ interprocess 
communication process, or by consultation of files generated by the FORTRAN 
modules. These files were formatted with the required mnemonics used in the facts 
database. The analysis of the FORTRAN modules was executed under schedule, and 
some syntax and logic errors were corrected. Concurrent to this analysis, the facts 
Barabase was corrected by Prof. Chin-Hwa Lee, and the svstem exercised to observe 
the behavior under the new conditions. 

Momooscive™ tac Teclllis aS tice precess goes through different stages in the 
Miteroretation process, two files are generated. [he first is the CHANGE.DAT file, 
which provides the user with global results derived from the Prolog Rules. These are 
Miewcertainty values used as evidence of the existence of a node. The file also shows 
some paramieters used by the Change Detection Process as the image file name and 
region description file name. CHANGE.DAT is used as the output file in which the 
Prolog Interpreter responds to the entry command file called RB-COM. The last one is 
used as a batch command file to provide the system parameters and rule invocation 
commands. 

itemcccond tie generated to show the results of the process is the file 
DEMON.DAT. This is a more detailed output that contains messages generated by 
each of the FORTRAN subroutines used along the main process. The information 
Written here is used mainly for debug purposes because it keeps track of the regions 
modifications created bv the Model Guided Split and Merge Module. Included in this 
file 1s information related to coordinates projected from earth svstem 3-D (latitude, 
longitude and height) to 2-D image coordinates. DEMON.DAT also presents the 
assigned properties to the new regions and the information of the shadow area 
generation. 

The system can also generate a set of output files which can provide an insight 
into how the process, as a whole is carried out. These files are generated when running 
the system under debug mode |. This is a more powerful mode and is used to 
understand the whole process, because it permits the graphic presentation of different 
regions as thev are being created by the model guided split and merge process, the 
displayed images show the predicted shadow areas and projected model locations. 


These files are numbered sequentially and have the general form MSGnnn and 
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DEMnnn, where nnn is a sequence number beginning with 0. These files are used by 
the program HJTEST to display on the COMTAL system the labeled region map and 
other areas as indicated before. 

By using these messages and demonstration files, is possible to understand the 
system behavior and detect possible errors in the process. It is necessary to mention 
here that the subroutine AFFIJ was created to shift the ‘model’ projection to its 
expected position. Due to errors in the collected data from the “model”, the Praia 
vertices were not coincident with the corners of the buildings observed in ciie os mmu 
photograph, some error was being introduced in the property results. The shadow 
properties were not exactly coincident and a ‘affine’ transformation was necessary to 
overlap the projected ‘model’ with the observed 2-D building projection in the aerial 
photograph. 

After the ‘affine’ process was performed, a better region matching was obtained, 
and the shadow module produced improved results because the projected predicted 
areas Were in position. However, 5 nodes were still not providing enough evidence to 
conclude their existence. Further study should be directed to determine the CAMA 
this anomaly. 

Because the amount of possibilities that could be presented to a system of this 
magnitude is enormous, the software review process still continues. However, as will 
be seen in later sections, the system performance was finally upgraded and all nodes 
Were properly evaluated, increasing with it the percentage of system accuracy. 

The software documentation has been written and is included as appendices at 
the end of the thesis . 


E. -MEASURING THE CPU TINIE 

Another objective of the thesis was the verification of CPU time consumption 
while running the Image Interpretation System in different debug modes. It has been 
observed that the system performs an immense amount of calculations, which are 
needed by the Image Processing operators in the computational environment to 
analyze the labeled region files and generate new regions under the model guided split 
and merge module. 

In order to have an efficient Image Interpretation Svstem, the svstem should be 
able to analyze aerial photographs in reasonable periods of time. Depending on the 


complexity of the buildings under consideration, the CPU time consumption will also 
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MODE --> DEBUG O DELEC 
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(1) Not used module. 


be different. For our experiment, we have used a 128 x [28 image, and the results are 
listed in Table 3 for a ‘model’ composed of 16 nodes. From the Table 3 it can be seen 


the great difference in CPU execution time consumption between DEBUG Mode 0 and 


DEBUG Mode I, which ts caused primarily because the last processing mode generates 
a set of demonstration images and messages for everyone of the splited and merged 
regions, it also show in these images the general evolution of the segmentation process 
by displaying continuously the labeled region map. 

Because there are intervals of time between the different process invocations, 
where the CPU have not been accounted by the program JCPET (TOS 
measuring subroutine ), the total CPU time cannot be calculate precisely. However, the 
results obtained reflect reasonable estimates when considering the magnitude of the 


process. 


D. INCORPORATING THE REFLECTANCE MOREEEING 
I. Introduction (Image Irradiance and Surface Orientation) 

Having reviewed the system software, measured the CPU time performance, 
and corrected some errors to improve system performance, there were still some nodes 
in the ‘model’ that were not being detected properly. Several factors were influencing 
the evidence necessary to determine the existance of these nodes. One OTC 
critical factor was related to the ‘certainty of tone. The weight assigned stom 
property combined with the difference in the predicted and calculated tone was 
lowering the final average of certaintv obtained bv combining the certainties of size, 
polygon and shadow of the node. Therefore, the need to obtain a more accurate 
predicted tone was an obvious objective to be pursued. 

An initial approach was suggested by the thesis Advisor to review some papers 
including an article on remote sensing, see (Ref 17), in order to incorporate retlectanes 
capabilities to the Image Interpretation System. The task was to be carried out by the 
computational environment to perform the analysis and find out the effects of scene 
illumination over the node surfaces. 

The problem of assigning a predicted tone for everv node lies in the 
observation of surface normals, see (Refs. 18, 19), sun position and observer Gosia 
it is necessary to find out how they affect the determination of an accurate predicted 
tone compared to the calculated tone from the node projection over the digitized image 
and give a reasonable similarity measure. 

Tone synthesis 1s based on a scene radiance equation that combines the 
bidirectional reflectance distribution function BRFD of the surface material. see (Ref. 
17), the spatial and spectral distribution of light sources, and some assumptions about 


the atmospheric attenuation and path radiance. 





2. Synthesis of the Tone 

Unknown parameters of the ‘model’ have been obtained from the real image 
by sampling and experimentation. The results of comparison with the predicted tones 
and the calculated tones from the image will be obtained when the certainty of tone 
mile is executed by the Rule Base expert. 

To synthesize the apparent brightness of a surface, we must consider the 
intrinsic reflectance characteristics of the surface material, the spatial and spectral 
distribution of the illumination, and the orientation of the surface relative to the 
observer and sun angle. The process uses the knowledge available at the time when the 
photograph was taken to simulate the relative angle of the light source. Also the 
reflectance factor of the surface (ALBEDO), which is unknown, is considered to be 
ideal for the effect of calculations and given a value of 1. We also assume that the 
surface materials forming the nodes are invariant with respect to the rotation of the 
surface normal, see (Fig. 4.1). 

To calculate the radiance equation, we need to obtain the direction of the 
incident angle I, the emergent angle E, and the phase angle G. The incident angle [ is 
the angle between the sun rays direction and the normal to the surface. The emergent 
angle E 1s the angle between the normal and the direction to the observer. The phase 
angle G is the angle between the incident and reflected rays. For a distant viewer and 
distant light source, as in the aerial photograph case, the phase angle G 1s constant. 

To calculate these angles, we need to define the gradient of the node surface 
Merial. and the gradient of the sun, which is the direction in the earth centered 
‘geocoordinate’ svstem. 

The BRDF (Bidirectional Reflectance Distribution Function) is an intrinsic 
property of a surface material. It determines how bright the surface will appear when 
viewed from a given direction and illuminated from another. 

When illuminating a surface by a collimated source with irradiance EO from a 
direction with gradient (PO, QO) and by considering the illumination from the sky as a 
hemispherical uniform radiance ES over the visible hemisphere, for the points not in 
shadow we get the following equation: see (Ref. 17). 

IA SEAN BEDOSc os) + ESTALBEDO*((1+cos( EJ): 2) 

This implies the use of the emergent angle E, because differing surface 
elements “see” differing amounts of the light source depending on surface slope. The 
ALBEDO is the reflectance factor of the surface considered ideal for the calculations 


with a value of 1. 
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The three angles I, G and E are used to specify the 
local geometry of the incident and the reflected ray. 


Figure 4.1 Local geometry of the incident and reflected rays. 


The equation takes into consideration the gradient of the node surface normal, 
and at first approximation, the ‘model’ uses the sun as a distant collimated source, and 
the sky as a hemispherical uniform source. 

The reflectance modelling program was created, and changes in the facts 
database Were generated to accommodate the system to this new capability. 

After several tries, the parameters used in the program were adapted to our 
‘model’ and the svstem performance was upgraded. As result, all the previous nodes 
that were not providing enough evidence, now show strong conditions as to be 


evaluated and identified positively as existing and unchanged nodes. 
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The reflectance modelling was performed with all the different nodes, involving 
different tones according to the node’s roof orientation, surface material category and 
image conditions. The results showed correspondence between the calculated values 
and the ones observed in the aerial photograph. 

Further tone changes in the facts database showed clearly the sensitivity of the 
stem to these changes. These experiments demonstrate the accuracy of the Image 
Interpretation System and the need of exercising the svstem under different conditions 


to calibrate the facts database to its optimum values. 
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Y. CONCLUSIONS 


Image Interpretation of Aerial Photographs is a difficult task considering the vast 
amount of calculations involved in the analysis of image arrays. By using a computer, 
in this specific case a VAX 11,780 running under the VMS operating system. and using 
an Expert System to ‘mimic’ the human reasoning it has been demonstrated that the 
process of detecting changes in buildings from an aerial photograph is a reality. Even 
more, this Expert System, which has been created under a firm base, could bea 
adapt to future expansions, or to be implemented in other Prolog environments. 

The ideas behind the system design are solid, promising and ambitious, the 
results are reliable and effective within the actual technology constraints. Tie 
objectives that were delineated in the initial statement of the investigation have been 
accomplished in the following wav: 

I. The in-depth analysis of all the Fortran programs and subroutines conforming 
the image processing operators and the Prolog facts database and Rule Base 
have been performed. Some logical and syntactical errors were Omi a 


corrected. The documentation of both environments, the Prolog and the image 
processing programs, was generated and are included as Appendices A and B. 


ta) 


The facts database was modified to accept the new reflectance capabilities 
introduced to the system. The changes were made according to experimental 
data sampled from the aenal po The Rule Base wás changed in the 
same sense, but only minor changes Were generated. These are located in the 
corresponding regions’ rule and are designed to receive the incoming results 
from the selecting regions module, which are originally created OT mEn 
reflectance program. 


The CPU time was measured, and it showed a distributed consumption over the 
different image processing operators and prolog area.. The values are within a 
reasonable margin and didn’t show any excessive time consumption in the 
Image Interpretátion system. 


Jd 


4. The process of exercising the system with different kinds of photographs has 
been partially simulated by using a. modified ‘model’. The results Show great 
ps of the system to changes in tonality and position of the nodes in the 
model’. 


Can 


The reflectance modelling capabilities were developed and implemented in the 
Image Interpretation Svstem. The overall results present higher accuracy aimee 
output from the Rule Base. There 1s clear evidence that indicates the progress 
obtained in the conclusions of matching the ‘model’ to the aerial photograph. 
his implies more confidence in the svstem productivity. 7 
The actual Image Interpretation System could be transformed into a faster, more 


reliable, and flexible system by the use of a more powerful Prolog conipiler Suche 
QUINTUS Prolog. The ideas used to develop this system are well concen can 
results are optimistic and the system could be enhanced in the future to generate its 


own rules and adapt more easily to a given situation. 





APPENDIX A 
PROLOG ENVIRONMENT SUMMARY 


ie RULE BASE EXPERT 
a. Functions performed 
Given a specific environmental ‘model’ and a defined camera conditions, find 
the changes in the digitized image taken from the aerial photograph. 
b. Definitions 
The certainty of Node N is: certainty_children (NV) ™ certainty_property (.V), 
where certainty_children is the arithmetic average of the certainty values of all children 
of the node, and certainty property is the weighted sum of its properties; checkinglist 1s 
one of the dynamic databases. 
c. Program structure 
The following steps are accomplished by the process in sequence: 
(a) Get the following input parameters from the user (example data): 
Labeled region file: Labfile (LLAB.DAT). 


Image file: Imgfile (L220200,.DAT). 
Side of the image: Sueras (BEE 
Debug Mode: Debug (0 fF; 2): 


Image Identification: Imageld (LEFT PICT1). 
Prolog region description file: Desfile as LDES.PRO. 

(b) Write the parameters in the file PARAM.DAT as well as the affine coefficientes 
for the respective side of the stereo pair of images. 

(c) Create the blackboard interprocess communication area by initiating the fortran 
program CRBKBD with the statement: “Simage” (crbkbd, (3, X ). 

(d) The Prolog expert must consult the region description file to get all the region 
properties. Continue reading the entry command file RB.COM and proceed with 
the subsequent control rules. 

d. Called routines 
CRBKBD: Creation of the ‘blackboard’ for interprocess communication. 
e. Other considerations 


None. 


Wi 
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FACTS DATABASE 


a. Functions performed 


The prolog file FACT.PL serves as the environmental model; it Has auemees 


like structure and it is the static database of the Change Detection System. 1ts tree 


structure 1s composed of a number of nodes, and each node has a unique name with 


almost similar format. The environmental ‘model’ has the following characteristics: 


(a) 


coefficient: 


smc_tone: 


The hierarchical relationship in the tree is fixed; the hierarchw Trono 
bottom of the building family is as follows: block, building cluster, building, 
building parts and subparts. 

Property inheritance: By this property, the system extracts the missing properties 
of a node from the ones of its ancestors. 


b. Definitions as used in the Prolog expert 


Affine transform coefficients. 


Surface Material Category. 


shadow_smc_tone: Variation of smc tone used for shadow areas. 


block: 
type: 
class: 
children: 
from: 


mbr: 


background_smc: 


context: 
compact: 
no venex: 
property: 


rel Point 


predictedeatea: 


A collection of tree roots. 

Defines the classification of hierarchies. 
Describes the type of environmental ‘model’. 

Are the roots originated in the node. 

Relates a node to its ancestors. 

Is the Minimum Bounding Rectangular area enclosing a node. 
The background sme surrounding the node base plane. 
Gives a written statement about the node identification. 
Gives a simple meaning of the general shape of the node. 
The number of vertices in the node polygon. 

Describes the 3-D coordinates of each vertex in the node. 
Provides the node’s height. 

Gives the properties and weights that should be analized for 
a given node. 

Reference point used to observe the sensed image light 
conditions. 

Opposite corner coordinates of the the rectangle enclosing 
the block used to detect if the sensed image holds the area 


. 


of interest for the change detection process. 
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c. Called routines 
None. 
d. Other considerations 


None. 


CONTROL RULE #1 
a. Functions performed 


Find the reference point ratió in order to modify the calculations of the 


change detection process accordingly to the light conditions on the image. Use the 


find_ref_ratio rule. 


(a) 


(b) 


Eist). 


b. Definitions 

None: 
c. Program structure 

The following steps will be accomplished by the process: 
Get from the facts database the reference point coordinates. Obtain the 2-D 
pecan coopamates Of the reference point: use the average value of the 
surrounding pixels in the image to get a more accurate reference. 
Compare to the facts database reference value and establish a ratio that will be 
used through the whole change detection process. 
d. Called routines 


The program PTPROJ is initiated with the sentence: ‘Simage’ ( ptproj, Coord, 


e. Other considerations 


None. 


CONTROL RULE #2 
a. Functions performed 


Mark a block as a root node for subsequent change detection process if the 


intersection area of it and a segmented image is large enough. 


b. Definitions 
Nome. 
c. Program structure 
The following steps will be accomplished by the process: 
Select a block from the facts database, use rype (Y.block), and get its MBR before 
initiating the fortran program PROJMBR; once we get back the 2-D image 


projection, use the SIDE parameter to extract the X and Y coordinates of the 


Sti 


(b) 


(d) 


(e) 


projection of the block, for the left or right side of the image stereo pairs use the 
routine_project_ mbr and separate _project_mbr rules. 

Obtain the image file identification and use it to extract the predicted area of the 
block from the facts database. Use the coordinates of the predicted area and the 
ones provided by the PROJMBR program to obtain the area of intersection of 
both MBRs; use the intersection_betw_mbrs rule. 

Get the size of the projected mbr and the size of the intersection part. use the 
nibr_size rule; obtain the ratio by dividing the ‘intersection MBR size Or E 
projected MBR’ size: use the ratio (Size [ms Sie MBR ees 

Check the ratio of intersection: if the block is identified to be in the image, its 
ratio should be higher and the change detection process could be initiated; use 
the check_block rule; the ratio must be over 60 per cent in order to determine 
that the block 1s positively located the image. 

By the same ideas, locate the building cluster from the block. get the building 
from the cluster and use the ratio of MBR's size intersection before checking the 
building in order to be sure that 1s properly located in the sensed image: when the 
building terminal nodes are detected, add them to the checking hist, which will be 
constructed as a hst of all the elements to be analized along the change detection 
Process. Use the following rules:  find_building_cluster_intersection, 
find_intersection_a_building, check_building and put_node to locate and add the 
node to the checking list. 

d. Called routines 


PROJMBR: initiated by using the statement “Simage” (project_mbr. MBR, 


Proj_MBR). 
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e. Other considerations 


None. 


CONTROL RULE #3 
a. Functions performed 

Activate one of the nodes in the ‘checkinglist’ dvnamic database. 
b. Definitions 


None. 





Gi 


Program structure 


The following steps will be accomplished by the process: 


Check if it is the last node in the ‘checkinglist’( the last one must be equal to 


“markL” ) by using the rule last_node_test (.\ ode). 


If it is not the last node, validate it through the analysis process; use the control 


rule 4: validate( Node) and retract it from the ‘checkinghst’ when finished. 


a. 


Called routines 
None. 
Other considerations 


None. 


CONTROL RULE #4 


a. 


Functions performed 

If the node is a non-terminal node, then add its children to the ‘checkinglist’. 
Definitions 

OMe: 

Program structure 


The following steps will be accomplished by the process: 


Get the children list of the node from the facts database and use the pur_node 


rule to initialize its certainty value to -9999. 


Include the node’s children in the “checkinglist”; use the validate (Yode) rule. 


d. 


Called routines 
None. 
Other considerations 


None. 


CONTROL RULE #5 


d. 


Functions performed 


If node is a terminal node, and its certainty value is undecided, then calculate 


its certainty value by combining all the property’s values obtained; update its father 


certainty and elinunate it from the checkinglist. 


p: 


Definitions 


None. 


(a) 


c. Program structure 

The following steps will be accomplished by the process: 
Calculate the property certainty of the node by first initializing the property 
certainty value to -9999; get the list of properties and its weights for the specified 
node from the facts database; obtain the combined certainty value for all the 
properties, by multiplying the weights of the individual properties by its certainty 
factors and dividing the result over the sum of all the weights ouis 
validate( Node) rule. 
Report its status (see control rule 10). 
Refine the results by the ‘model’ guided split and merge program; if the results 
are not satistacion (see leo: 
Update the father certainty of the node (see rule No. 8). 
Remiove the node from the ‘checkinglist’ (see ruleNo. 6). 
d. Called routines 

None. 
e. Otlier considerations 


None. 


CONTROL RUC 
a. Functions performed 


If the certainty values of the node’s children are completely decided, then 


update the certainty value of the node’s father. 


(a) 


(0) 


b. Definitions 

Nome: 
c. Program structure 

The following steps will be accomplished by the process: 
Obtain from the facts database the list of all children corresponding to a node's 
father. use the from (Node, Father) and children ( Father, L) facts. 
Get all the children’s certainty value; if one of them have not been solve 
return; use the all_children_solved ( L, ChildrenNo) rule. 
Combine the children certainty factors and get the average bv dividing the total 
sum of children’s certainty over the mumiber of children) USAS 


combine_certainty_of_children ( L, Children_No, X/) rule. 
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(d) 


(e) 


(f) 


Find the father’s property certainty; in case that there are particular properties to 
find, like ‘shadow’, use the find_father_property_certainty (Father, Walue) and 
calculate_property_certainty (Father) rules, as seen in control rule No.5 part (a). 
@oniaine the clildren and fatlier certainties: if one of them is equal to -9999 or 0, 
use the other to obtain the combined value, use the 
combine_children_and_property_certainty rule. 
Replace the ‘instantiated’ value of -9999, report its status and repeat the process 
for the upper hierarchies. 
d. Called routines 

None. 
e. Other considerations 


None. 


CONTROL RULE #9 
a. Functions performed 


If the certainty value of a node is decided, then remove the node and its 


successors from the ‘checkinglist’. 


(a) 


b. Definitions 
None. 
c. Program structure 
The following steps will be accomplished by the process: 
Get the node’s children list and remove the list from the facts database; use the 
remove_from_checkinglist and remove_children rules. 
d. Called routines 
None. 
e. Other considerations 


None. 


CONTROL RULE #10 
a. Functions performed 

If the certainty value of a node is decided, then report its status. 
b. Definitions 


None. 
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(b) 


tele 


c. Program structure 
The following steps will be accomplished by the process: 
Get the node's certainty value from the facts database using the certainty _value ( 
Node, Value) fact: 1f the value is -9999 return. 
Check the value against certain limits to decide different conclusions; write the 
results in the CHANGE.DAT report file, use the status (Node, Value) rule. 
d. Called routines 
Nome: 
e. Other considerations 


None. 


CONTROL RULE #11 
a. Functions performed 


Split and merge: If the certainty of a mode cannot be decided arto rE 


properties are evaluated, then try to split and merge the regions associated with the 


node (these are the corresponding regions obtained by the corresponding_regions rule). 


(a) 
(b) 


(d) 


b. Definitions 

None. 
c. Program structure 

The following steps will be accomplished by the process: 
If the certainty value of the node is already greater than 00 per csi a 
If not, get the possible regions list that was generated by the corresponding 
regions rule and call the MGSM program to reconfigure the regions intersecting 
the node’s projection, in order to evaluate more precisely the d:flerent ‘propensi 
certainty factors, use the possible_regions ( Node, RegList) fact. 
The facts database is modified according to the results produced by the MGSM 
program, these results include the new region properties in thee 
NEWPROP.DAT, use the updare a record (Biennio 
Calculate the property certainties as was done in the control rule No. 5 and 
report the new status, use the calculate_property_certainty ( Node) rule. 
d. Called routines 


MGSM: initiated by the sentence Simage (mgsm, Regiista 
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e. Other considerations 


None. 


CERTAINTY OF TONE 
a. Functions performed 


The certainty of tone is assigned according to the average value of the tone 


difference of all the corresponding regions. 


(a) 


(c) 


(d) 


lb. 


b. Definitions 

None. 
c. Program structure 

The following steps will be accomplished by the process: 
Get the list of corresponding regions to the node's projection; use the 
corresponding regions rule. 
Get the surface material categorv of the node from the facts database and 
multiply it by the ratio obtained in control rule No. 1, this is the node relative 
grav level. 
Obtain the difference of tone in each one of the corresponding regions, with the 
relative gray level of the node being analized. Get the hist of tone differences and 
sizes of each tone included in the corresponding regions list, use the sub rone diff 
and list_of_tone_diff rules. 
Obtain the weighted average by multiplying and summing the tone and size of 
each one of the corresponding regions over the sum of the intersected region’s 
area, use the weighted_sum rule. 
Assign a tone certaintv value according to the weighted average obtained. use the 
assign _value_tone rule. 
d. Called routines 

NONE, 
e. Other considerations 


None. 


CERTAINTY OF SIZE 
a. Functions performed 


Assign a certainty value according to the ratio between the node size and the 


sum of all the corresponding region’s sizes intersecting the projected node. 
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b. Definitions 
None. 
c. Program structure 
The following steps will be accomplished by the process: 

(a) Get the list of the corresponding regions and their sizes, get the mapped size of 
the node from the facts database generated by the corresponding _regions rule. 

(b) Assign a value according to the ratio between the mapped size and the sum of 
the list. use the RATIO fact and assign_value size rule, to generate the certaintv 
value of this rule. 

d. Called routines 
NOTE: 
e. Other considerations 
The /list_of region _size rule gets from the facts database the sizes of all the 
corresponding regions. The RATIO is defined as mapped node size over sum of the 


corresponding regions; the last predicate is obtained through the swm_lis¢ rule. 


l4. CERTAINTY OF SHADOW 
a. Functions performed 
Assign a value to the shadow certainty according to the predicted and 
calculated shadow areas projected from the node. 
b. Definitions 
The property inheritance: a concept used when the property of a node 1s not 
found, it is searched through its ancestors; to obtain it use the find_background_smc 
eer 
c. Program structure 
The following steps will be accomplished by the process: 

(a) Obtain the node's descendants: get the node’s cluldren from the facts database, 
and with this information, create a table of possible descendants initializing the 
last element to “markL” ; continue searching for new generations until all 
descendants are collected; use the find next generation, collecti descendant aami 
getnext_des (DES) rules. 

(b) Generate the shadow projected polygons: for every descendant node get the 
number of vertices forming the polvgon and extract its coordinates to be written 


into the file PROJSH.DAT; use the form proj polygons and write_proj_coord 





(c) 


(d) 


(e) 


parts 


rules. Note that the projected shadow coordinates were originally generated by 
the ‘corresponding regions’ rule, which called the SELREG program, and wrote 
them in the PROJCO.DAT file. 
Initiate the shadow processing program SHDPRO with the statement ‘Simage’ 
(ship). 
After the program SHDPRO generates a list of area-tone pairs, these are the 
different regions intersecting the projected shadow areas; obtain the average 
wighted tone value after summing the weighted tones and dividing proportionally 
to their areas; use the weighted sum shadow rule. 
Assign a value to the shadow certainty, according to the absolute difference 
between the predicted tone of the projected shadow, and the calculated tone of 
De ol loewincerseeting Geelons taken from the image file; use the 
assign_value_shadow and certainty_value shadow rules. 
d. Called routines 

SHDPRO: Shadow processing program. 
e. Other considerations 


None. 


CERTAINTY OF POLYGON 
a. Functions performed 

Generates a certainty value according to the ratio between the intersecting 
of the regions overlapping a node and the mapped size of it. 
b. Definitions 

None. 
c. Program structure 

The following steps will be accomplished by the process: 
Serie mapped Size of the node from the facts database; obtain also the 
intersected area’s size of the different regions by using the mapped size and 
intersect_area facts: add the list of intersection areas and obtain the ratio by 
dividing it over the mapped size; use the sum_list rule; assign a certainty value 
according to the ratio; use the assign_value_polygon rule. 
d. Called routines 


Nene: 
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e. Other considerations 


None. 


16. PROLOG COMMON ROUTINES 
a. Functions performed 

Provide information for several properties and rules through the change 
detection process. 

b. Corresponding regions rule: 

The purpose of this rule is to find the regions related with a specific node; it 
produces the following facts and tables to be used by the Interpreter: mapped size of 
the node, list of regions corresponding to a node area and areas of intersection, also 
generates through program SELREG, and the projected and shadow predicted 
coordinates of the node vertices. The following steps will be accomplished by the 
process: 

(a) Check if the possible regions table already exists; return if so. If not create a 
vertex file called VERTEA.DAT to be used by program SELREG cal 
command ‘Simage’ (selreg. {}, M). 

(b) From the list received through mailbox created at the conclusion of SELREG, 
generate the list of intersecting areas and possible regions overlapping the 
projected node; use the collect_regions and region_number_and_intersec_size rules. 
c. Mathematical common routines. 

The mathematical common routines are used to find differences, min, max and 
absolute values. 

d. Utility common routines 
Are used to find the minimum number in a list as min_list, and number of 
elements in a list as no_elements rule. 
e. Called routines 
None; 
f. Other considerations 


None. 





APPENDIX B 


COMPUTATIONAL ENVIRONMENT SUMMARY. 


l. PROGRAM (FORTRAN) ’SELREG’ 


a. Functions performed 


Select a list of regions intersecting with the area projected by a node from. the 


environmental ‘model’ and get a list of the image projection coordinates in 2-D 


corresponding to the vertices of the node and their shadows. This information will be 


Written into a file to be used by the shadow verification subroutine. Additionally, this 


program will handle the modification of the facts database according to new tone 


values generated by to the sun position relative to the node surface normal. 


b. Input 
SODES AME: 
POSE: 
COORD: 
ENA GS: 
NOME: 

c. Output 
VERTE. 
ISS 
FONE: 
NSOREG: 
NOPOINTS: 
OST: 

JOR GS OUT: 


d. Common area 


The node being analized. 

The node tone before sun illumination analysis. 
RESCATA Coondmatesss. 1,7 of every node vertex. 
The number of arguments received through mailbox. 


The number of vertices for each node. 


The 2-dimension coordinates of each vertex projection. 

The 2-dimension coordinates of each vertex shadow projection. 
The modified value of the tone for each node. 

The region intersecting the node projection. 

The number of pixels related to the intersection area. 

The output buffer to be sent through mailbox. 


The number of arguments being send out. 


The common area called BOARD has been developed to provide interprocess 


communication through a background storage and includes: 


MODEL: 
REGMAP: 
PR 

SEN ANG: 
PLXGOEF: 
PRESTO: 


This matrix provides the ‘model’ 2-D projection. 
Includes all the seginented regions. 

Sidteot vie stereo pair Of images, 

Provides with the absolute sun direction. 

are the base plane coefficients A, B, C and D. 


A value used to identifv the progress report files. 
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COEF: Coordinates corresponding to the exposure station. 


Wink G5. Is the number of regions identified in the photograph. 
AREA: The region s arcai 
PERT The tegion s pemmicter 
COMPACT: Parameter that show a generated shape relation of the region. 
MTONE: The average tone of each region. 
VION: The tone variance of ever reg momi 
MBR: The minimum boundary rectangle for everv region. 
DEBUG: The type of debug process under execution (UN 
IMAGE: The digitized image of the aerial photograph. 

e. Work area 
NCHARS: The number of characters in the node name. 
MBR2D: The MBR of every node projection. 
STRBEE, A buffer to hold the input data for the program. 
EE Number of elements returned by subroutine CON Vena 
U, V, W: Real values for X Y andi) 
CORT er Variables to hold the CPU time consumed by the program. 
RC Or: Matrix to hold the real values of the node’s vertices. 
OMRNE OS: The number of regions intersecting the node projection. 
RATIO: The relation of the intersected part to the modes 
NOUMODEL: Number of pixels in the ‘model’. 
MBRINT: The MBR of the intersection part for every corresponding 

region. 


f. Parameters and modes 
This program is designed to work with debug modes 0 and I (mode 2 is under 
development), when running in mode I there is additional information generated which 
will be displaved in the COMTAL environment to show the process progress report. 
The program uses as parameters, ISX and [SY with values of 128 which ares 
ranges in X and Y of the aerial photograph; MAXREG is 100 and it is the linut of 
regions to be obtained from the segmented image: finally the left side of the stereo pair 
is assigned as a value of | and the right one as 2. 
g. File handling 
DEMON.DAT: Output file that contains all process messages. 
VERTEX.DAT: Input file created by the change deteenram process 


in order to provide with the input parameters. 
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(a) 


(b) 


(c) 


PROJCO.DAT: Output file to be consulted by the shadow processing 
subroutine, it include projected and shadow coordinates. 

h. Program structure 

The program for region selection is summarized in the following steps: 
The selecting regions program is initiated by the Prolog Interpreter, and the first 
task is to establish communication with the memory management interprocess 
routines: event flag association, mailbox communication and logical unit 
association. 
ie wilew Die ViON OAT 1s opened to receive all the information regarding the 
development of the process and the file VERTEX.DAT is opened to provide all 
the input parameters; next all the work area variables are initialized. 
Inmediately for every vertex are calculated its 2-D projected and shadow 
coordinates and also generated the minimum boundary rectangular of the node. 
The new tone for the node is then calculated with all the information relating the 
plane equations of the different node vertex combinations. 
The MODEL matrix is progressively being generated with all the accumulated 
2-D projection of the different nodes, where the previous processed nodes are 
represented by code ‘2° and the last node by ‘I’;the last node being processed is 
retained in the matrix BUF 2D to be used for intersection calculations. 
Finally all the intersecting regions and their intersection area will be transfered 
back to the calling program via mailbox interprocess communication. 
i. Exception handling 

or used. 

Calling routines 


This program is initiated by the Prolog Interpreter during execution of the 


Statement Simage' (selreg,{},M)" in the “"corresponding-regions” rule. 


k. 


Called routines 


ezine Used to calculate the CPU time. 

BLCKBRD: To obtain connection with the blackboard storage. 
Al): Generate additional affine transformation to the image. 
CONVERT: To transform the ascii to integer values. 

PROIECT.: To project a 3-D coordinate to 2-D coordinate. 

ered: Perform the affine transformations of the image. 
SHADOW: Used to generate the shadow projections. 

REFLEC: To calculate the tone variation of the node. 
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REGENDE To fill the intersected part of a region and node. 
PICESA M: Used to provide a different filename for the progress 
report process while working in mode |. 
|. Timing constraints 
Not observed. 
m. Other considerations 
(a) In order to link this program, the following command will have to be given: 
Slink selreg, afhj, blkbrd, shadow, convert, ufo create, ufo_open, filenam, jcput, 
reflec, projmbr. projaff, regfill, blkbrd:opt. 
(b) The changes performed to the program are related to the insertion of the timing 


routines, and with the generation of the new tone for the diflerent nodes 





according to the sun position. 


>. PROGRAM (FORTRAN) ’MGSNI’ 
a. Functions performed 
Is the main program of the ‘model’ guided split and merge module. 
b. Input 
ESOS: The number of arguments received through mailbox. 
RECI List generated by corresponding regions rule. 
c. Output 
The output of this program is transfered to the Prolog Expert thromam 
mailbox. 


d. Common area 
The common area called BOARD has been developed to provide interprocess 


communication through a background storage and includes: 


MODEL: This matrix provides the ‘model’ 2-D projection. 
REGMAP: Includes all the segmented regions. 

LR: Side of the stereo pair of images. 

SE SANG: Provides with the absolute sun direction. 

PESCO: Are the base plane coeflicients A, B, C and D. 
PILESEO: A value used to identify the progress report files. 
Cor: Coordinates corresponding to the exposure station. 
AREG Is the number of regions identified in the photograph. 
AREA: The Tresions area 

PERI The region s permier 
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COMPACT: Parameter that show a generated shape relation of the region. 


TONE: The average tone of each region. 

V TONE: The tone variance of every region. 

MBR: The munimum boundary rectangle for everv region. 
DEBUG: Meppel dene process Under execution (0,1 or 2). 
IMAGE: The digitized image of the aerial photograph. 


e. Work area 
Not used 
f. Parameters and modes 
This program is designed to work with debug modes 0 and 1 (mode 2 is under 
development), when running in mode 1 there is additional information generated which 
will be displaved in the COMTAL environment to show the process progress report. 
The program uses as parameters, ISX and ISY with values of 128 which are the 
ranges in X and Y of the aerial photograph; MAXREG is 100 and it is the limit of 
regions to be obtained from the segmented image; finally the left side of the sterco pair 


is assigned as a value of l and the right one as 2. 


IQ 


. File handling 


we 


DEMON.DAT: Output file that contains all process messages. 


— 


1. Program structure 
The program for split and merge 1s summarized in the following steps: 

(a) This is the main program of the module, is in charge of handling the interprocess 
communication and passing parameters to the subroutine REFINE, which 
practically performs all the splitting and merging tasks. 

1. Exception handling 

Ou used. 

j. Calling routines 
This program is initiated by the Prolog Interpreter during execution of the 

Meoremient Simase (mgsm,{},M)" in the control rule No. 11. 

k. Called routines 
REGINE: To refine the region's association with the node. 

1. Timing constraints 


Not observed. 


m. 


(a) 


Slink mgsm, refine, assreg, neighreg, tone, measone, measreg, Wrprop. jcput, 


filenam, ufo_create, ufo_open, blkbrd, npsSlibrarv:spiderlib. lib 


DI PROGRANI (FORTRAN) ‘SM’ 


a. Functions performed 


uses the RSAM segmentation process which is one of the SPIDER library subroutines. 


b 


Other considerations 


In order to link this program, the following command will have to be given: 


To segment an image based on an split and merge algorithm. The program 


Input 


Input data is entered interactively by the user. 


Output 





A tone data file, and a region labeled file are generated. 


Common area 
Not used. 


. Work area 


PAE: 
Oc TE: 
INGE re 
Lie 

MAP: 

LO: 

Le: 
JERR 
JP: 

INR: 
EEE 


NTARKEA: 


tarea): 


The image file name as L220200.DAT. 

The output labeled region ile as LLAGAS 

Input buffer to hold each input file record. 

The image data in integer format, values from 0 to 255. 

Character codes to label the segmented regions. 

Level at which segmentation starts (default = 3). 

Logarithm to base 2 of ISX and ISY = 7 (for ISX= 128). 

Retunmerror code: 

Output labeled buffer. 

Index of labeling codes used with “MAP”. 

Maximum difference for merging and splitting a region, 

the default value is 20 over250 possibi: 

Area threshold for small region elimination performed 

after each region grouping (default = ISN*ISY 200). 

One dimensional array in which threshold of difference 
in image intensities is stored as function of area in 


small region elimunation (def. values are 50 to 30). 


(a) 


(b) 


(c) 


(d) 


f. Parameters and modes 
A noise region is defined as ISX*ISY_ 1000. 


File handling 
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esse: Input file with the digitized image data. 
OUTFILE: Output file with the labeled regions. 
TONE.DAT: Output file with the tones of all labeled regions. 


h. Program structure 

The following steps will be accomplished by the segmentation process: 
Get the input parameters : The image file name, output labeled region file and 
prepare them to process the input/output data, also the file TONE.DAT is used 
to place all the tone information related to the different regions. 
For diagnostic purposes, the process display the multiples of 16 No.s of records 
as they are being read from the input file; load the image data after transforming 
it from byte format to integer format with values varying from 0 to 255. 
Generate the parameter and arrays as required bv RSAMI; the actual values used 
are: THY = 70, LO = 4, NTAREA = 120. NTINT(1)= 70, NTINT(ntarea) = 
70, then call the subroutine RSAM, and after return check for error codes. 
Silec muiemcemrems ol every teciom generated, and decide if it is too small to be 
considered as noise; assign to it one of the possible ascii codes. 
Obtain the tone of the region and write it in the tone file to be consulted by the 
Prolog Interpreter. 
i. Exception handling 


This program checks for error codes generated by RSAM; check if the region 


number exceeds 200, which is the maximum value; and provide with error messages. 


le 


Calling routines 


This program is a preparatory step previous to the invokation of the Change 


E ection System. 


k. 


Called routines 
RSAM: Segmentation routine from the Spider Library. 
Timing constraints 


Not observed. 


m. Other considerations 


None. 


un 
tsa 


4. PROGRAM (FORTRAN) ’SHDPRO’ 


a. Functions performed 


This program will generate: a list of regions intersecting the projected shadow 


area, and their mean tone values: to do it . this subroutine will use the vertices of the 


node and the projected shadow points that were generated by the subroutine 


SHADOW; this list of regions and tones will be used by the shadow certainty rule of 


the Change Detection System. 


b. Input 
IN ARGS: The number of arguments received through mailbox. 
NES: The number of vertices in a polygon. 


Note that the received coordinate buffers are composed of 4 elements, the 


order used is: 2-D coordinates of the projected image and 2-D coordinates of the 


predicted shadow points. 


c. Output 
The output parameters are send out via mailbox interprocess communication 
scheme: 
HOST: The average grav value of the intersection area. 
IN POTS S: The number of pixels related to the intersection area. 
OBUF : The output buffer to be sent through mailbox. 





NARGS_OUT: 


d. Common area 


The number of arguments being send out. 


The common area called BOARD has been developed to provide interprocess 


communication through a background storage and includes: 


MODEL: This matrix provides the ‘model’ 2-D projection. 
REGIS: Includes all the segmented regions. 
PR: Side of the Stereo pair of amiaces: 

UNANG: Provides with the absolute sun direction. 
PESCO Are the base plane coelficients Ar RECETTE 
FICEST O: A value used to identify the progress report files. 
CORE: Coordinates corresponding to the exposure station. 
NE: Is the number of regions identified in the photograph. 
AREA: The region’s area. 
PERI The region s pemmerer | 
COMPACT: Parameter that show a generated shape relation of the region. 
ANTOS E: The average tone of each region. 
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V TORE: 
MBR: 

DEBUG: 
IMAGE: 


. Work area 


STRBUP: 
NES SHD 
IN. OWI: 
MBR_QUAD: 
PREDRECG: 
POU aor, 
MBR2D: 


GI: 


NO REGS: 


NP_PREDREG: 


Wie RE: 


POINT: 


CP: 


AS 


SOLI- 


he DC. 


QUADLTL: 


Nod: 


nesrone variance Of every region. 
The minimum boundary rectangle for every region. 
The type of debug process under execution (0,1 or 2). 


The digitized image of the aerial photograph. 


A buffer to hold the input data for the program. 

The number of points in the calculated shadow area. 
Number of elements returned by subroutine CONVERT. 
Is the MBR that holds the QUADLTL polygon. 

Buffer to hold the total calculated shadow area. 

Buffer to hold the coordinates that form the projected node. 
Hold the projected vertices and the shadow pro- 

jection VIBR area generated by shadow process. 

Are logical values generated by the logical function PLUMB, 
and indicate wether a point is in or out a polvgon. 

The number of regions selected as candidate shadow 
projection regions. 

The number of points in the total calculated shadow 

area generated by the polygon. 

It holds the projected edge coordinates and predicted shadow 
coordinates from a polygon. 

Temporary area used by subroutine CONVERT to transfer 
1ts output results. 

Buffer to hold the central points of the lines joining 
adjacent edge coordinates or shadow projection points. 
Coordinates in X at a distance DIST of the central 

point as explained in CP. 

Coordinates in Y at a distance DIST of the central 

point as explained in CP. 

Are the line coefficients of the line joining two adjacent 
projected vertices or predicted shadow coordinates. 

Is an area formed by the predicted shadow coordinates and 
the node's edge projection points that originated them. 

[s the number of points that have been generated in the 


predicted shadow projection process. 
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JIS CIGH: Offset to enlarge 1 pixel around the total calculated shadow 
area. 
MBR_INT: MBR to hold the intersection of the shadow area with a 
Specilied region 
RATIO: Is the number of points in the shadow intersection to the 
number of points in the total shadow ratio. 
BT: Buffer to hold the calculated shadow projection from a 
mode sedas: 
f. Parameters and modes 
As parameters used by this subroutine, we find the following: DIST is the 
distance from a calculated point perpendicular to the central point in a line joining two 
vertices, this is initialized to 0.1; MIN_RATIO: 1s the value used to determine if the 
intersected part of a shadow and a specific region is large enough, this value 1s 
initialized to 0.1; and MAX BOUNDARY, 1s the number of points necessarv to 

trigger the analysis of a specific region adjacent to a shadow area, it 1s initialized to 3. 

This program is designed to work with debug modes 0 and 1 (mode 2 is under 
development), when running in mode 1 there is additional information generated which 
will be displaved in the COMTAL environment to show the process progress report. 

The program uses as parameters, ISX and [SY with values of 128 which are the 

ranges in X and Y of the aerial photograph; IAXREG is 100 and it is the linut of 

regions to be obtained from the segmented image. 
g. File handling 
DEMON.DAT: Output file that contains all process messages. 
PROJSHD.DAT: Input fite that contains the projected vertices coordinates 
and the predicted shadow coordinates. 
h. Program structure 
The program for shadow generation is summarized in the following steps: 

(a) Initiate interprocess communication through event flag association, mailbox and 
logical unit selection; open the files DEMON.DAT and PROJSHD.DAT in order 
to write all the development messages, and to get the input parameters. Finally 
the work area is initialized by clearing the buffers to hold the predicted shadow 
region and MBR2D 1s initialized. 

(b) The input parameters (2-D vertex coordinates and predicted shadow projection) 
are loaded into the program, and the MBR that holds the total node projection ts 


generated. 





(c) 


(d) 


(e) 


(1) 


The projected shadow is generated by first calculating the central points of both 
predicted shadow projection sides, and projected edge sides; this is performed bv 
finding the point in a vertical line that is perpendicular to the line connecting two 
adjacent vertices. If this connecting line is not parallel to one of the axis (X or 
Y), then the slope and the intersecting points will have to be used in order to get 
the line coefficients and by this, obtain the central points. 

Once the possible solutions are obtained by offseting the central points to both 
fimesmor ete sconnecting line by a distance DIST, then the logical function 
PLUMB will provide with the logical values FLAGI and FLAG2, which are the 
indicators to decide if the possible solution lies inside or outside the polygon 
formed by the vertices and the shadow projection points. 

By choosing the solutions that lie inside the polygon formed by the predicted 
shadow points, it is possible to decide if one of the sides of the node is generating 
a real shadow, the method used is to verify if a central point of an edge.and the 
interior point of the shadow polygon lie in the same side of a line connecting two 
adjacent shadow projected points. 

A MBR called MBR2D that was holding the node projection. now 1s also 
enlarged to hold the calculated shadow projection; The calculated shadow that is 
underimposed by the node projection is eliminated from the predicted region 
area. In case of working under mode l, the shadow shapes projected from each 
side of the polvgon are transfered to demonstration files. 

Now, the shadow shape is enlarged by one pixel in order to elimunate the 
discrepancies in the compactedness of the shadow shape. 

With the shape of the shadow finally generated, the area is intersected with the 
regions of the labeled region map in order to find the intersection part belonging 
to every different region. The intersected parts are evaluated according to its size 
to decide if they are large enough to be included in the output list. 

The minimum bounding rectangular areas are calculated for each intersection 
part, and with these limits is possible to obtain the average tone of the 
intersection part from the reference image. 

Finally the results are transfered back to the certainty shadow processing rule in 
the change detection system via mailbox. At the end of the program execution, 
the logical units used will be freed and an event flag is set to indicate a 


completion status. 


1. Exception handling 
Not used. 
j. Calling routines 
This program ts initiated by the Prolog Interpreter during execution as 
statement “Simage’ (shdpro.{',L)” in the “certainty-of-shadow” rule. 


k. Called routines 





¡SRT Used to calculate the CP 

BUONI: To obtain connection with the blackboard storage. 
REE TEIE: To fill a shadow projection representation. 
QUADEO: To obtain the solution for a quadratic equation. 
COVERI To transform the ascii to integer values. 

PLUMS: Logical function used to verify if a point is inside 


Or outside a given polygon. | 
FILENAM: Used to provide a different filename for the progress 
report process while working in mode 1. 
|. Timing constraints 
Ol Cosemed: 
m. Other considerations 
(a) In order to link this program, the following command will have to be given: | 
Slink shdpro.blekbrd, plumb, quadeq, ufo create, ufo open filenam, jcput. 
projmbr, projaff, regfill, blkbrd; opt. 
(b) The program assumes that sun light is the only light source, and that the 
background of a tested object is composed of one material. The certainty value 
of shadow is proportional to the estimated shadow predicted region over the 
average tone from the intersection part of the image with the shadow projection. 
(c) The changes in this program were related with the detection of some errors rae 
position in the vertex buffer of the projected and shadow coordinates was 
interchanged; also the use of the PREDREG array replaced properly Mesas 


the MODEL arras in same senei S 


S; PROGRANI (FORTRAN) ’CRBKBD’ 
a. Functions performed 
The principal function of this program is the creation of the ‘blackboard, 


which is an area defined for interprocess communication and the measurement of the 


region’s properties from a labeled picture, which will be stored in a common area called 
BOARD; the interested properties are: size, perimeter, compactedness, tone variations 


and minimum bounding rectangular. 


b. Input 
IN ARGS: The number of arguments received through mailbox. 
PRICRFCE: The file that contains the tabeled regions map. 
PVIGRICE: The file that contains the digitized image. 

c. Output 


The common area BOARD is generated during the blackboard generation 
process and also the same information is written in a region description file to be 
consulted by the Rule Base expert. 

d. Common area 
The common area called BOARD has been developed to provide interprocess 


communication through a background storage and includes: 


Bonde E- This matrix provides the ‘model’ 2-D projection. 
REGMAP: Includes all the segmented regions. 

ER: Side Or iWerstereo pair Of iniages. 

SUNANG: Provides with the absolute sun direction. 

BIFNGORE: Are the base plane coefficients A, B, C and D. 

ier oL ©: A value used to identifv the progress report files. 
COEF: Coordinates corresponding to the exposure station. 
NREGS: Is the number of regions identified in the photograph. 
AREA: ite necions area: 

PERI The region’s perimeter. 

COMPACT: Parameter that show a generated shape relation of the region. 
wil ONE: The average tone of each region. 

\ITONE: line one valance O| every resion. 

MBR: The nunimum boundary rectangle for every region. 
DEBUG: Whe type of debug process under execution (0,1 or 2). 
IMAGE: The digitized image of the aerial photograph. 


. Work area 


SSB E: A buffer to hold the input data for the program. 
I Oe ete: A file to hold the Prolog region description data. 
COMPACT: Used to measure the compactedness of a region. 


f. Parameters and modes 
This program is designed to work with debug modes 0 and | (mode 2 is under 
development), when running in mode 1 there is additional information generated which 
will be displayed in the COMTAL environment to show the process prosressimenane 
The program uses as parameters, ISX and ISY with values of 128 which aras 
ranges in X and Y of the aerial photograph; MANREG is 100 and it is the limit of 
regions to be obtained from the segmented image. 


g. File handling 





CB RIE: The file that contains the labeled regions map. 
IM GEILE. The file that contains the digitized image. 
PRO ele: A file to hold the Prolog region description data. 


DEMON.DAT: Output file that contains all information regarding 
the development of the change detection process. 

PARAM.DAT: — Input file created by the Rule Base interpreter and 
provides with the input parameters to blackboard. 

LODES ERO Output file to be consulted by the Prolog Interpreter. 
it contains the region description information. 

h. Program structure 

The program for blackboard creation 1s summarized in the following steps: 

(a) The sun angle and plane coefficients arrays are initialized with the corresponding 
data from the sun direction and base plane equation. The data for left and right 
side of the stereo pair, and affine coefficients are also provided by the amp 
parameters. 

(b) If debug mode 1 is in progress, then the original region map will be transfered to 
a demonstration file; REGMAP is also generated from the labeled file and the 
IMGFILE is assigned to the corresponding image file with the pixel values 
transformed to integers from 0 to 235; the field NREGS in the common area is 
also generated with the number of regions in the labeled file. 

(c) Using a set of different subroutines, the BOARD arrays for minimum bounding 
rectangular, size. perimeter, and tone are calculated and a region description file 
is generated. 

(d) The data to be fed through the blackboard for the different fortran subroutines, 
is also written in the Prolog region description file that later will be.consulted bv 


the Rate ss ase expen 
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(e) 


ie 


At the end of the program execution, the logical units will be freed and an event 
flag is set to indicate a completion status. | 
1. Exception handling 

Not used. 

Calling routines 


This program is initiated by the Prolog Interpreter during execution of the 


statement “’Simage (crbkbd,{},X)” in the initial stage of the Rule Base expert. 


(a) 


(b) 


(c) 


K. 


Called routines 

BLKBRD: Serve as the data structure ‘blackboard’ creation routine. 
CQLTI: Generates the MBR for the different regions. 

PROT 2: Alea ee el meten ol the specified regions. 
AREA2: Measures the size of the labeled regions. 

TONE: Get the mean tone and variance of the different regions. 
STRIZ: Measures the coordinates of the starting points on the 


border of a specified region. 

PILE NAM: Used to provide a different filename for the progress 
report process while working in mode |. 

Timing constraints 


Not observed. 


m. Other considerations 


In order to link this program, the following command will have to be given: 
Slink crbkbd, blkbrd, convert, ufo open, ufo create, filenam, jcput,tone, 
svsSlibrary:spiderlib; lib. 

The process of assigning values to the variables in the ‘blackboard’ must be done 
after the file is opened, otherwise the values will be reset to zero because the 
memory pages assigned to the ‘blackboard’ are demand zero pages, and are 
initialized to O by the operating svstem. 

To calculate the compactedness of a region. the relation of area of the region 
against the area of a circle is used, as reference, the compactedness of a circle is 


L. 
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6. PROGRAM (FORTRAN) ’PTPROJ’ 
a. Functions performed 
This program) is used to obtain the reference point projected from 3-D to 2-D 
coordinates in order to establish a ratio between the predicted image conditions and 
the observed values obtained by the average of tone in the reference point for Oeeees 


accuracy the surrounding pixels to the reference point are also considered for the 


. Common area 


calculations. 
b. Input 
INNARGS: Number of input arguments. 
e Coordinates of the reference point. 
. Output 
IMGREFE: The reference point value calculated. 
N: Number of Output arguments. 


The common area called BOARD has been developed to provide interprocess 


communication through a background storage and includes: 


MODEL This matrix provides the ‘model’ 2-D projection. 
REGMAP: Includes all the segmented regions. 

ER Side of the stereo pair of images. 

SUNANG: Provides with the absolute sun direction. 

PISGOEE: Are the base plane coefiicients TAR TCE TOND 
PIBESEO: A value used to identify the progress report files. 
CORE: Coordinates corresponding to the exposure station. 
AREGS.: Is the number of regions identified in the photograph. 
AREA: The regions arca 

PERIT The region s perimeter 

COMPACT: Parameter that show a generated shape relation of the region. 
MESE: The average tone of each region. 

TONE: The tone variance of every region. 

MIBR: The minimum boundarv rectangle for every region. 
DEBUG: The type of debug process under execution OA 
IMAGE: The digitized image of the aerial photograph. 





e. Work area 
Pioneer: Logical unit to be created. 


CFO OLER: Logical unit to be opened. 

L VRY: Poa auna ea eS Or A, 1, 2. 

K: Coordinate in 2-D of the reference point. 
SRORDER: Fortran attribute flags. 

SSIECDEF: Attribute flags for private’ global section creation 


and mapping. 

f. Parameters and modes 

Not used. 
g. File handling 

Not used. 
h. Program structure 

The program for reference point projection is summarized in the following 

steps: 

(a) The reference point projection prograin 1s initiated by the Prolog Interpreter, and 
the first task is to establish communication through the memory management 
interprocess routine: event flag association, mailbox conimunication and logical 
unit association. 

(b) The input parameters are loaded; the location of the reference point in 2-D is 
generated. 

(c) The average value of the surrounding points to the reference point included is 
calculated from the image; finally before returning, the logical units are freed and 
an event flag 1s set to indicate a completion status. 

1. Exception handling 
Not used. 
j. Calling routines 
This program is initiated by the Prolog Interpreter by using the command 
‘Simage’ (project_mbr. MBR, Proj_MBR), in control rule No. 2. 
k. Called routines 
PROJECT: To project a 3-D coordinate to 2-D coordinate. 


ROO AB Perform the affine transformation. 
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l. 


IM. 


Timing constraints 
Not observed. 


Other considerations 


7, — SUBROUTINE (FORTRADE AETI 


à. 


Functions performed 


Perform the affine transformation (2-D image to 2-D image 6 parameter 


transformation) includes a rotation, non perpendicularity of the axes, two scale changes 


and (Vo tramslations: 


p 


Input 

SIS: These are the Image coordinates to be affined. 
Output 

OA Are the transformed 2-D image coordinates. 


. Common area 


Not used. 
Work area 
PHOTO TO DIGITAL IMAGE TRANSFOR 1 OR 


Transformation from the photograph coordinates to the digital image 


coordinates is called an affine transformation and represents a rotation, 


nonperpendicularity of the axes, two scale changes and two translations. This implies 


the solution of the equations: 


AP=SX(COS(BETA)-DELTA*SIN(BETA))XI-(S Y*SIN( BE Tay at 
YP=SX(SIN(BETA) + DELTA*COS(BETA))XI + (SY *COS(BE TA) ee 
where 

XP, YP = Photo coordinates 

AI, YI = Image coordinates. 

SAX, SY = Scale changes. 

CI, C2 = Translation in both axes. 

DELTA = Nonperpendicularity or affinity between the axes X, Y. 

BETA = Rotation angle. 

Al = Si(COS( BETA) - DELTA Sine Ay 

A? = SY(SIN(BETA) + DELIA COs aie) 

Bl = -SY"SIN( BETA) 

B= tS COSTED 


64 





This transformation is also called 6-parameter transformation. This process 


has been implemented in this subroutine AFFIJ. 


(a) 


fi 


E 


Parameters and modes 
File handling 


Not used. 


. Program structure 


Not used. 


The program for affine transformation is suinmarized in the following steps: . 


Solve the affine transformation equations to convert the photo coordinates to 


display coordinates. 


ts 


DO. 


Exception handling 

Mot used. 

Calling routines 

SDEREG: Select regions intersecting with the projected node. 
SHADOW: Used to generate the shadow projections. 

Called routines 

Not used. 

Timing constraints 

Not observed. 

Other considerations 


Not used. 


SUBROUTINE (FORTRAN) ’JCPUT’ 


di 


Functions performed 


Obtain the CPU time consumed in a specific program. 


. Input 


Gre I. Variable to hold the system CPU time. 
Output 
Not used. 


. Common area 


Not used. 
Work area 
BUE: Buffer to hold the information required by SYSSGETJPI. 


(FQ 


Parameters and modes 


Not used 


. File handling 


Not used 


. Program structure 


The program for CPU time calculation is summarized in the following steps: 


(a) Generate the information necessary to call the system utility S Yss@r lem 


ie 


m. 


Exception handling 
OL sed: 


Calling routines 


SE PREG: Select regions intersecting with the projected node. 
SHIDPRO: Shadow processing module. 
REPUNE; To refine the region’s association with the node. 


Called routines 

Not used. 

Timing constraints 
Not observed. 
Other considerations 


Not used. 


9. SUBROUTINE (FORTRAN) ’PROJMBR’ 


a. 


Functions performed 


This program is used to project the 3-D MBR of the node projection into 2-D 


left and right image coordinates. 


b. 


Input 

INNARGS: Number of input arguments. 

zi Coordinates of the MBR. 

Output | 

MBR2D: The 2-D coordinates of the MBR. 
Common area 

Not used. 


Work area 


UNE Real equivalent values of X, Y, Z. 
JE: Hold temporarily the 2-D MBRs: 
LOLUN: Logical unit to be used as input, output. 
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f. Parameters and modes 


Not used. 


g. File handling 


DEVON DAT: 


Output file that contains all process messages. 


h. Program structure 


The program for minimum boundarv rectangular calculation is summarized in 


the following steps: 


(a) The minimum boundary rectangular program is initiated by the Prolog 


Interpreter, and the first task 1s to establish communication through the memorv 


management interprocess routine: event flag association, mailbox communication 


and logical unit association. 


(b) The input parameters are loaded; the location of MBR 2-D is generated. 


L. 


Exception handling 
Not Used. 
Calling routines 


This program 1s initiated by the Prolog Interpreter by using the command 


images project mbr, MBR, Proy VIBR) in the execution of control rule No. 2. 


k. 


m. 


Called routines 


PROJECT: To project a 3-D coordinate to 2-D coordinate. 
Sores: Perform the affine transformation. 
BLCKBRD: To obtain connection with the blackboard storage. 


Timing constraints 
Not observed. 
Other considerations 


Not used. 


10. SUBROUTINE (FORTRAN) “REFINE? 


a. Functions performed 


Refine the results provided by a basic segmentation algorithm according to the 


intersection part of the area mapped from a ‘model’ and the regions of a labeled image. 


The refine process implies the creation of new regions from the intersected parts and 


the reconfiguration of the whole region map in order to simplify the analysis of the 


change detection process. 
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b. Input 


Se 


properties after the refine process. The elements moldear m3 


REGNO: 
NOS 
Output 


Region list associated with a specific node. 


Number of regions listed for the chosen node. 


The common area BOARD 1s updated by including the new regions and its 


REGMAP, AREA, 


PERI, COMPACT, MITONE and VY TONE. 


d. Common area 


The conimon area called BOARD has been developed to provide interprocess 


communication through a background storage and includes: 


€: 


MODEL. 
REGMAP: 
ER: 
SUNANG: 
PENCOERFE. 
FILE E 
CORE: 
NREGS: 
AREA: 
PERI: 


COMPACT: 


M TONE.: 
NTO E 
MBR: 

DEBUG: 
IMAGE: 


Work area 


This miatrix provides the ‘model’ 2-D projection. 
Includes all the segmented regions. 

Side of the stereo pair of images. 

Provides with the absolute sun direction. 

Are the base plane coellicients A, B, C and D. 

A value used to identifv the progress report files. 
Coordinates corresponding to the exposure station. 

Is the number of regions identified in the photograph. 
The region s area. 

The region s pertinetem 

Parameter that show a generated shape relation of the region. 
The average tone of each region. 

The tone variance of ever testo 

The nunimuni boundary rectangle for every region. 
The tvpe of debug process under execution (0,1 or 2). 


The digitized image of the aerial photograph. 


M_AREA, M_PERI, M_MBR, M_TONE, M_VTONE, M_COMPACT are 


the temporary variables assigned to hold the related information for the node in 


process as explained previously in part 4. 


[Nis AREA 


INTS PERI, INTS_ TONE, INTS_ WO 


INTS_COMPACT are the temporary variables assigned to hold the related information 


for the intersection part as explained previously in part 4. 


OS 





NEW_PERI, 


temporary 


NEW_TONE, 


assigned 


New VIGNE, 
to hold the 


NEW_AREA, 
BEW COMPACT are the 


information for the new created region as explained previously in part 4. 


variables related 


NOREGS: The total number of regions identified in REGMAP. 
RECT: Temporary area to hold the MBR of the region under test. 
FILESEO: A sequence to identifv a demonstration file. 

JP: Array to hold a region without the intersection part. 

IP: Array to hold the intersection part. 

RATIO: The intersection part over the node area ratio. 

RATIO2: The intersection part over the region size ratio. 

REGEIST: A list of regions neighboring another. 

CONTESTI Variables to hold the CPU time consumed by the program. 


NEIGH_REGS: 


The number of regions neighboring another. 


BURZI: An area that shows the merged regions for debug purposes. 

NCAND: The candidate region with the most sinular characteristics 
(6 Une Teg1om my erocess. 

ee eGo lle number ol mew recions obtained from the 


intersection part of a node. 
INE WOE BL IMAGE: 


generated regions. 


An area with new labels for all the new 


f. Parameters and modes 

The following three variables must come from the Rule Base interpreter in the 
final version: LOW_BOUND which is initialized to 5, 1s the size of candidate noise: 
IUP_BOUND which is initialized to 30, is the maximum grav difference for small 
region merging; GRAY DIFF which is initialized to 10 is the maximum gray difference 
for big region merging. It also uses as a parameter, NEWREG, which is initialized to 
20 and is the maximum number of new regions that could be generated after the 
splitting and merge process. 

This program is designed to work with debug modes 0 and 1 (mode 2 is under 
development), when running in mode l there is additional information generated which 
will be displaved in the COMTAL environment to show the process progress report. 
eee prolram uses as parameters, ISN and ISY with values of 128 which are the 


ranges In X and Y of the aerial photograph. 
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g. File handling 
When working in mode 1, the files “(DEMFILE’ and “MSGFILE’ will be 


opened by the subroutine FILENAMI, and closed by the refine process after writing the 


debug information. 


(d) 


(e) 


DEMON.DAT: Output file that contains all process messages. 
h. Program structure 

The following steps will be accomplished by the refine process: 
Work area variables and parameters are initialized. 
For every region that intersects the ‘model’, there are two new arrays generated: 
IP and JP which respectively contain the intersection part and the region without 
it; this will be used later when deciding if an intersection part is too small or not 
in relation to the node or region size. 
The properties (area, perimeter, compactedness, gray differences) are measured 
for the ‘model’ and the intersection part; some debug information is send to the 
demonstration files. 
The size of the intersection parts is analized in relation to the size of the ream 
and the ‘model’: if it is too big in relation to both, then this intersection part will 
not be considered for the splitting and merge process. 
If the intersection is small, then it will be sphted according to the shape of the 
‘model’, and the resulting regions will be merged with the neighbor region that 
have the most sinular characteristics. 
The new properties will be generated and the facts database will be updated 
properly. 
1. Exception handling 

Not used. 

Calling routines 


This subroutine is called by the Model guided spht and merge program 


(WGSV) with the sentence: call reline (REG LISAS 


k 


Called routines 
IOPU Used to calculate the CRU TTE 
VIEASREG: Used to get the new properties of a group of regions. 


NEIGHREGS: It get all the neighbor régions fronta seleccion 
NEASONE: Measure the area, tone, mbr and compactedness of 
the a selected region. 


WRPROP: Write properties of a region in a file to be consulted 
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(a) 


(b) 


(c) 


hi. 


by the Change Detection process. 

ASSREG: Is used to generate new regions froma splited intersection 
part of a node. 

FILENAM: Used to provide a different filename for the progress 
report process while working in mode |. 

Timing constraints 


Not observed. 


m. Other considerations 


In order to link this program, the following command will have to be given: 
Slink mgsm, refine, assreg, neighreg, tone, measone, measreg, Wrprop, jcput, 
filenam, ufo_create, ufo_open, blkbrd, blkbrd/options, svsSlibrarv:spider.lib 
A noise region is defined as a regions whose size is smaller than LOW_BOUND 
and its tone variance is greater than UP_BOUND. 

Changes to the program REFINE were made in the way that all the new data 
generated for the merged and splited regions could be effectively transfered to the 
database and common area BOARD, so it could be used appropriately by the 
incoming processes. Other changes performed to the program are related with 


the insertion of the timing routines. 


SUBROUTINE (FORTRAN) ’BLKBRD’ 
a. Functions performed 


The principal function of this program is to create and map a section in 


memory to serve as a data structure for the ‘blackboard’ interprocess communication 


area. 


b. Input 
Not used. 
c. Output 
Not used. 
d. Common area 


The common area called BOARD has been developed to provide interprocess 


communication through a background storage and includes: 


MIEL: This matrix provides the ‘model’ 2-D projection. 
ISE: Includes all the segmented regions. 

ER Side of the stereo pair of images. 

SO NANG: Provides with the absolute sun direction. 


Dai 


(a) 


(b) 


Gi 


GQ 


EEOC OED 
bICESEO; 
COET. 
NREGS: 
AREA: 
PERE 
COMPACT: 
TORT.: 
VTONE: 
MBR: 
DEBOG. 
IMAGE: 


Work area 


UFO_CREATE: 


CFO OPES 
ADDR: 
SEO 
SCD 


Parameters and modes 


Not used. 
File handling 


Not used. 


. Program structure 


Are the base plane coefficients A, B, C and D. 

A value used to identify the progress report files. 

Coordinates corresponding to the exposure station. 

{s the number of regions identified in the photograph. 

Wie regiousarecr 

The region’s perimeter. 

Parameter that show a generated shape relation of the region. 
The average tone of each region. 

The tone variance of every region. 


The minimum boundary rectangle for every region. 





The type of debug process under execution (VIO 


The digitized image of the aerial photograph. 


Logical unit to be created. 

Logical unit to be opened. 

To provide the limits of the background area. 
Fortran attribute flags. 

Attribute flags for private, global section creation 


and mapping. | 


The program for blackboard creation 1s summarized in the following steps: 


The blackboard creation prograni is initiated by the Prolog Interpreter, and the 


first task is to establish communication through the memory management 


Interprocess routine: event flag association, mailbox communication and logical 


unit 


association. 


Also 


the input parameters are loaded from the file 


PARAM.DAT and the labeled and image files are opened. 


This subroutine uses the SYSSCRMIPSC system utility to create and iia 


section in the memory, it is the actual blackboard area the one being created and 


mapped. 


i 


1. Exception handling 
Aot used. 
j- Calling routines 
This subroutine is called by CRBKBD and all the fortran programs that want 


to get the interprocess communication established; they are: 


NU ve Main program of the ‘model’ guided split and merge process. 
SELRECG: Select regions intersecting with the projected node. 

SD PRO: Shadow processing module. 

Eber: Used to generate a point projection (3-D to 2-D). 


k. Called routines 
The system utility LIBSGET_LUN allocates one logical unit from a system 
process wide pool. 
l. Timing constraints 
Not observed. 
m. Other considerations 


fee slink crbxbd, bikbrd, convert, ufo open, ufo create, filenam, jcput.tone, 


svsSlibrarv:spiderlib, lib. 


12. SUBROUTINE (FORTRAN) ’PROJECT’ 
a. Functions performed 
The main function of this subroutine is to perform a 3-D earth coordinate to 
2-D image coordinate transformation for a given point coordinates. 
b. Input 
A. These are the Object coordinates. 
c. Output 
XIMA, YIMA: Are the transformed 2-D image coordinates. 
d. Common area 
The common area called BOARD has been developed to provide interprocess 


communication through a background storage and includes: 


MODEL: This matrix provides the ‘model’ 2-D projection. 
REGMAP: Includes all the segmented regions. 

LR: Side of the stereo pair of images. 

SUNANG: Provides with the absolute sun direction. 

GP base planeo Micients AB. E and D. 
meee oO: A value used to identify the progress report files. 


a3 


CORR 


Coordinates corresponding to the exposure station. 


NREGS: Is the number of regions identified in the photograph. 
AREA: The regions area 

PERI The region’s perimeter. 

COMPACT: Parameter that show a generated shape relation of the region. 
NETO NE: The average tone of each region. 

VIONE: The tone variance of evemaneciome 

MBR: The minimum boundary rectangle for every region. 

DEBIL: The tvpe of debug process under execution (0) ore 
[MAGE: The digitized image of the aerial photograph. 


. Work area 


NCHARS: The number of characters in the node name. 

FOCOS: Focal length. 

XO, YO: Fiduca E enter 

DENONE Used for simplifving the transformation (denomunator). 
OMEGA: Exterior orientation parameter: rotation about the X axis. 
PHT: Exterior orientation parameter: rotation about the Y axis. 
KAPPA: Exterior orientation parameter: rotation about the Z axis. 
E A E Exposure station: Object coordinates of the perspective 


CENTET 


COSOME, SISOME, COSPHI, SINPHT, COSKAP, SINKAD are TESPOCH 





the cosine and sine of the angles omega, phi and kappa, used as exterior orientation 
parameters; the angle units is in radians. 
MIL to M33 are the Orientation Matrix coefficients. 
f. Parameters and modes 
The interior orientation parameters are: X0, YO and FOCUS; the exterior 
orientation parameters are: NL, YL, ZL OMEC PA s 
This program 1s designed to work with debug modes 0 and 1 (mode 2 1s under 
development), when running in mode 1 there is additional information generated which 
will be displaved in the COMTAL environment to show the process progress report. 
g. File handling 


DEMON.DAT: Output file that contains all process messages. 
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h. Program structure 
The program for data projection is summarized in the following steps: 
following steps: 

(a) The Orientation Matrix is generated for every side of the stereo pair image, and 
the image coordinate system is constructed by using the orientation matrix 
coefficients, the interior orientation parameters and the exterior orientation 
parameters. 

1. Exception handling i 
Not used. 


j- Calling routines 


PROJ MBR: Project a MBR from 3-D to 2-D coordinates. 

Ste REG: Select regions intersecting with the projected node. 
SHADOW: Used to generate the shadow projections. 
PTEROJ: Used to generate a point projection (3-D to 2-D). 


k. Called routines 
Not used. 

|. Timing constraints 
Not observed. 

m. Other considerations 


Not used. 


13. SUBROUTINE (FORTRAN) ‘’XY2IJ’ 
a. Functions performed 
Perform the affine transformation (2-D photograph to 2-D image 6 parameter 
transformation) includes a rotation, non perpendicularity of the axes, two scale changes 


and two translations. 


b. Input 
e: These are the Photograph coordinates. 
c. Output 
E Are the transformed 2-D image coordinates. 


d. Conimon area 


Not used. 
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Gi 


Work area 
PHOTO TO DIGITAL IMAGE TRANSFOR ies 


Transformation from the photograph coordinates to the digital image 


coordinates is called an affine transformation and represents a rotation, 


nonperpendicularity of the axes, two scale changes and two translations. This implies 


the solution of the equations: 


XP = $X(COS(BETA)-DELTA*SIN(BETA))XI-(SY#SIN(BETA))YI + Cl 
YP =SX(SIN(BETA) + DELTA*COS(BETA))XI +(SY*COS(BETA))YI + C2 


where 


XP, YP = Photo coordinates 

XI, YI = Image coordinates. 

SX, SY = Scale changes. 

Cl, C2 = Translation in both axes. 


DELTA = Nonperpendicularity or affinity between the axes X, Y. 
BETA = Rotation angle. 


This transformation 1s also called 6-parameter transformation. This process 


has been implemented in this subroutine NY2IJ. The following data has been provided 


for the analysis of the aerial photographs under test: 


GQ 


Al = SX(COS( BETA) - DELTA*SIN( BETA)) 
A2 = SY(SINBETA) + DELTA*COS(BETA)) 
BIS ES IN 

B2 = +SY*COS(BETA) 


Parameters and modes 


. File handling 


Not used. 


. Program structure 


Not used. 


The program for affine transformation is summarized in the following steps: 


Solve the affine transformation equations to convert the photo coordinates to 


displav coordinates. 


i. 


Exception handling 


Not used. 
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j- Calling routines 


PROJMBR: Project a MBR from 3-D to 2-D coordinates. 
SERES: Select regions intersecting with the projected node. 
SHADOW: Used to generate the shadow projections. 

Peano J: Used to generate a point projection (3-D to 2-D). 


k. Called routines 
Not used. 

l. Timing constraints 
Not observed. 

m. Other considerations 


Not used. 


i4. SUBROUTINE (FORTRAN) ‘CONVERT’ 
a. Functions performed 


Convert a string buffer from the character data type to integer data tvpe. 


b. Input 
STRBUF: The character string containing the input data. 
NUM: The number of values to be transfered back. 

c. Output 
List: The list of integer values to be returned. 


d. Common area 
The common area called BOARD has been developed to provide interprocess 


communication through a background storage and includes: 


VIO EL: This matrix provides the ‘model’ 2-D projection. 
REGMAP: Includes all the segmented regions. 

ER Seto ne stereo par ol Images. 

SUNANG: Provides with the absolute sun direction. 

PES OEF: ANTS the base plane coeliicients A, B,C and D. 

LE SE O: A value used to identify the progress report files. 
COET Coordinates corresponding to the exposure station. 
REGS: Is the number of regions identified in the photograph. 
AREA: The region’s area. 

FERI Tie reciOn s Perimeter: 

COMPACT: Parameter that show a generated shape relation of the region. 
M TONE: The average tone of each region. 


10 


VTONE: The tone variance of every region. 





MBR: The minimum boundary rectangle for every region. 
DEBUG: The tvpe of debug process under execution (0,1 or 2). 
IMAGE: The digitized image of the aerial photograph. 
e. Work area 
IGN: The sign of the cutout value, 
NO: Number of elements that are being generated. 


f. Parameters and modes | 
The variable ISIGN has the values ‘1’ for positive and -1 for negative vali | 
the character buffer being transformed is 72 characters long. 
g. File handling 
DEMON.DAT: Output file that contains all process messages. 
h. Program structure 
The following steps will be accomplished by the conversion process: 
(a) For every character in the string buffer, check first the sign of the NUM maea 
verify that the number is an ascii code between 0 and 9. check dilleneme 
numbers by detecting the ‘,” code and finish when locating the closing bracket of 
the hst of characters from the input buffer. 
1. Exception handling 
This program will issue error messages when detecting incompatible number of 
integers. 
j. Calling routines 
This program is called bv issuing the command ‘ call convert (strbuf, list, 


inum) ° and the following routines are calling this program: 


CREEK BD: Generates the blackboard area. 

SHADOW: Used to generate the shadow projections. 

SEE O: Select regions intersecting with the projected node. 
SHDPRO: Shadow processing module. 


k. Called routines 

|. Timing constraints 
Not observed. 

m. Other considerations 


Not used. 


15. SUBROUTINE (FORTRAN) ‘SHADOW’ 
a. Functions performed 
The function of this program is to find the 2-D shadow coordinate projected 


from a 3-D coordinate object. 


b. Input 
aie: he Goordinates:o! the object. 
SUNANG: Array that gives the sun direction. 
FO COEF: Values for base plane coefficients A, B, C and D. 
COFF. Affine coefficients. 
ER: Side of the stereo pair of images. 
c. Output 
ISS: The shadow image coordinates. 
d. Work area 
Ses SZ: Are the projected shadow coordinates in 3-D. 
R The distance from the object to the ground. 


e. Parameters and modes 
This program is designed to work with debug modes 0 and | (mode 2 1s under 
development), when running in mode l there is additional information generated which 
will be displayed in the COMTAL environment to show the process progress report. 

The program uses as parameters, ISX and ISY with values of 123 which are the 

ranges in X and Y of the aerial photograph. 

f. File handling 
o mode I the files DEMPFILE” and MSGFILE will be 
opened by the subroutine FILENAM, and closed by the refine process after dumping 
the debug information. 
DEMON.DAT: Output file that contains all process messages. 
g. Program structure 
The following steps will be accomplished by the shadow process: 

(a) This program uses the plane coefficients of the building background base in order 
to obtain the distance from the vertex to the ground ; with this information, an 
the sun position, the estimated ground coordinates where the shadow will be 
located are obtained. 


(b) Then this coordinates of the shadow in 3-D are transformed in 2-D. 
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. Exception handling 


used. 
Calling routines 


This subroutine 1s called by SELREG using the command ‘ call shadow(x,y,z. 


sunang, plncoef.Ir,is.js). 


iF 


Called routines 


OE To project a 3-D coordinate to 2-D coordinate. 

Abili Generate additional affine transformation to the image. 
ZII Perform the affine transformation. 

FILENAM: Used to provide a different filename for the progress 


report process while working in mode |. 
Timing constraints 
Not observed. 
Other considerations 


Not used. 


16. SUBROUTINE (FORTRAN) ’FILENAND’ 


dll 


Functions performed 


This subroutine generates a sequence of differents demonstration files included 


under the variables DEMFILE and MSGFILE while running the Change Detection 


Svstem under debug mode |. 


b. 


Input 

PITESEO: Value that shows the actual order for file creation. 
Output 

FILE SAVI: Character string buffer to be used for opening 


the Demonstration and Message files. 


. Common area 


Not used. 
Work area 
Notused: 
Parameters and modes 


Not used. 


SO 
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g. File handling 
The demonstration files with sequence DEMO001 to DEM999 and the message 
files with sequence MSG001 to MSG999 are created and opened in the logical units l 
ee E ame (| VisGFILE) according to the Change Detection process needs. 
h. Program structure 
The program for file names generation is described as follows: 
(a) <Ascit characters are generated by translating the integer sequence FILESEQ digit 
by digit, and incrementing the sequence previously for every new file needed. 
1. Exception handling 
Not used. 
}. Calling routines 


This program is called when running under mode debug ‘1’ by the following 


programs: 
See G: Select regions intersecting with the projected node. 
SE To refine the region’s association with the node. 
SHDPRO: Shadow processing module. 
CRERBD: Generates the blackboard area. 
SHADOW: Used to generate the shadow projections. 
MEASONE: Measure the area, tone, mbr and compactedness. 
MEASREG: Used to get the new properties of a group of regions. 


k. Called routines 
Not used. 

I. Timing constraints 
Not observed. 

m. Other considerations 


Not used 


17. SUBROUTINE (FORTRAN) ’QUADEQ’ 
a. Functions performed 
This program finds the solution of a quadratic equation. 
b. Input 


A, B,C: These are the equation coefficients. 


Sl 


c. Output 
KET 2: These are the calculated real solutions. 
d. Common area 
Not used. 
e. Work area 
Aot used: 
DELTA: The expression B"*2 - MATO 
f. Parameters and modes 


Not used. 


aQ 


File handling 
DEMON.DAT: Output file that contains all process messages. 
h. Program structure 
(a) Uses the formula solution= (-B + sqrt(delta))/(2*A) to find the real roots 
of the equation. 
1. Exception handling 
This subroutine checks for no real solutions or input coefficient errors. 
j. Calling routines 
This subroutine 1s called by the following programs: 
SHDERO: Shadow processing module. 
k. Called routines 
Not used. 
l. Timing constraints 
Not observed. 
m. Other considerations 


Not used. 


18. SUBROUTINE (FORTRAN) ’MEASREG’ 
a. Functions performed 
The principal function of this program is to measure the properties of a 
labeled picture, the interested properties are: size, average gray level permea 


compactedness; this data is obtained for a group of regions. 


b. Input 
IE: The intersectedi part 
IMAGE: The file that contains the image picture. 
ISSS. The image dimensions in A andire eae 


(a) 


NREGS: 
IRA 


MAXREG: 


c. Output 
AREA: 
PERE 
COMPACT: 
MITOSE. 
VIONE: 

d. Common area 
Not used. 

e. Work area 


Not used. 


Number of regions in the region map. 

The index region number (selected region for 

the measurements. 

Value used for dvnanuc dimension of the labeled 


region buffer. 


The region’s area. 

Therecion s perimeter: 

The region's compactedness. 

The average tone of the region's gray values. 


The region’s tone variance. 


f. Parameters and modes 


Not used. 


g. Program structure 


The program for region measurement is summarized in the following steps: 


Using a set of different subroutines, the different region properties are calculated 


for the specified regions. 


h. Exception handling 


Not used. 


1. Calling routines 


iiiemcubroutine 1s called by REPENE, using the command: call measreg(ip, 


image, iSX, iS¥. nregs, irn, area, perl. compact, mbr, mtone, vtone, maxreg). 


le 


Called routines 
COME 
PRENT? 
AREA2: 
LOSE: 
STRI: 


FILENAMI: 


Generates the MBR for the different regions. 

Measures the perimeter of the specified regions. 
Measures the size of the labeled regions. 

Get the mean tone and variance of the different regions. 
Measures the coordinates of the starting points on the 
border of a specified region. 

Used to provide a different filename for the progress 


report process while working in mode |. 
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(a) 


k. 


l. 


Timing constraints 

Not observed. 

Other considerations 

To calculate the compactedness of a region, the relation of area Ol the 
against the area of a circle is used, as reference, the compactedness Of a citciame 
la 


SUBROUTINE (FORTRAN) “TONE?” 
a. Functions performed 


Find the mean and variance of the gray level for a specified region. 


b. Input 

LABEL: The labeled region file. 

IMAGE: The image file. 

ISS e The image dimensions (assigned a value of 128). 

REGNO: The region number being processed. 

RECTI The Minimum Boundary Rectangular of the region. 
c. Output 

MEAN: Average gray value of the region. 

VAAN Ge: Variance of the gray level in the region. 


d. Common area 
Not used. 


e. Work area 


NOOR AS: Number of pixels integrating the region. 
SUM: Sum of the image values. 
SE MSO: Sum of the image values squared. 


f. Parameters and modes 
Not used. 
g. File handling 
DEMON.DAT: Output file that contains all process messages. 
h. Program structure 
The program for tone generation is summarized in the following steps: 
Obtain the mean = SUYA OCOT SE 
Obtain VARIANCE = ((SUMSQ - SUM * SUM)'NOPOIN TSAS OPOTI 
1). 
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i. Exception handling 
Not used. 
j. Calling routines 
The following routines call this program using the command call tone(label, 


image, iSX, isy, mean, variance, RegNo, rect). 


CRBKBD: Generates the blackboard area. 
MEASONE: Measure the area, tone, mbr and compactedness. 
MEASREG: Used to get the new properties of a group of regions. 


k. Called routines 
Dot used. 

|. Timing constraints 
Not observed. 

m. Other considerations 


Not used. 


ee SUBROUTINE (FORTRAN) “WRPROP’ 
a. Functions performed 
To write the new Region Properties into the file NEWPROP.DAT that will be 


consulted by the Prolog Interpreter. 


b. Input 
I: The region number. 
AREA: The region’s area. 
PERI: ie terion s perimeter. 
COMPACT: The region’s compactedness. 
MTONE: The average tone of the region’s gray values. 
VICO NE: The region’s tone variance. 
c. Output 
Not used. 


d. Common area 
Not used. 
e. Work area 


Not used. 
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f. Parameters and modes 
Nol used. 
g. File handling 
The file NEWPROP.DAT is output file opened in logical unit No. 13. 


h. Program structure . 





The program for tone generation is summarized in the following steps: 

(a) The input parameters are formated and written to be loaded as new facts in the 
file NEWPROP.DAT with the following mnemonics preceding item 
REG_SIZE, REG_PERI, REG_COMPACT, REG_TONE. 

1. Exception handling | 
INGE used, 
j- Calling routines 
The following programs call this subroutine: 
REFINE: To refine the region’s association with the node. 
The command used ts: call wrprop (1, area, peri, compact, mtone, vtone) 
k. Called routines 
DORSE 
I. Timing constraints 
Not observed. 
m. Other considerations 


At present time the facts for perimeter and compactedness are not being used. 


21. SUBROUTINE (FORTRAN) ’MEASONE?’ 
a. Functions performed 
The principal function of this program is to measure the properties of a 
labeled picture, the interested properties are: size, average gray level, perimeter, 


compactedness; this data is obtained for a particular region. 


b. Input 
Les The intersected tam 
IMAGE: The file that contains the Image prou! 
ESA ES The image dimensions in X and Y (use 129 
AREG Number of regions in the region map. 
IRS: The index region number (selected region for 
the measurements. 
MAXREG: Value used for dynamic dimension of the labeled 


SÓ 


(a) 


c. Output 
AREA: 
PERI 
COMPACT: 
MTONE: 
VTONE: 

d. Common area 
Not used. 

e. Work area 


Not used. 


region buffer. 


Thewegion s area. 

Wie restos perme. 

The region's compactedness. 

The average tone of the region's gray values. 


The region's tone variance. 


f. Parameters and modes 


Not used. 


(JQ 


Program structure 


The program for region measuremient is summarized in the following steps: 


eee set cl cieret Subroutines, the dillerent region properties are calculated 


for the specified region. 


h. Exception handling 


Not used. 
1. Calling routines 


This subroutine 1s 


called by REFINE, using the command: call measone (ip, 


Mage, 15%, 1Sy, nregs, irn, area. peri, compact, mbr, mtone, vtone, maxreg). 


j. 


Called routines 
CORE: 

PRM 12: 
AREAZ2: 
TONE: 
SIET 


FILENAM: 


Timing constraints 


Not observed. 


Generates the MBR for the different regions. 

Measures the perimeter of the specified regions. 
Measures the size of the labeled regions. 

Get the mean tone and variance of the different regions. 
Measures the coordinates of the starting points on the 
border of a specified region. 

Used to provide a different filename for the progress 


report process while working in mode 1. 


(a) 


L 


Other considerations 


To calculate the compactedness of a region, the relation of area of the region 


against the area of a circle is used, as reference. the compactedness Of a cineiemm 


le 


SUBROUTINE (FORTRAN) “NEIGHREGS’ 


d. 


Functions performed 


Generate a list of region neighbors to a Specified one. 


. Input 


ISS: 
E BISI: 
RECT. 
REGNO: 


Pelo 


Output 

REGECIST: 
XREGS 
NEW LEBO IMG 


. Common area 


Not used. 
Work area 
Jaer. 
DISRIE 


The image coordinate dimensions (value of 128). 

Is the labeled region map. 

Limit of search enclosing the selected 

The mother region from where new smaller regions 
were generated. 

The selected region for which neighbors regions 


are search. 


List of regions neighboring a specified one. 
Number of regions neighboring a specified one. 
The labeled map after splitting an intersection 


part into new several smaller regions. 


Variables to hold the location of search. 
Are the displacements in the four possible 


directions of searching (up, down, left, right). 


Parameters and modes 


Not used. 
File handling 
DEMON.DAT: 


. Program structure 


Output file that contains all process messages. 


The program for neighbor location is summarized in the following steps: 


$$ 





(a) Get the input parameters and use the MBR of the region intersecting the ‘model’ 


to limit the search for the regions not being equal to the mother region, and that 


are surrounding the specified new region. 


(b) Search in all directions to find the neighbor regions. 


1. 


Exception handling 


Not used. 


Calling routines 


This subroutine is called by REFINE, using the command: 


call neighregs 


few lol img Wbl_ img, 15x, 1sy, label, rect, nregs, RegList, Rego ). 


K. 


m. 


Called routines 


Not used. 


Timing constraints 


Not observed. 


Other considerations 


23. SUBROUTINE (FORTRAN) ’ASSREG’ 


a. Functions performed 


part from an old region. 


Assign new region labels to the regions formed bv extracting an intersection 


b. Input 


E. 


LABEL: 
RECT: 
ISA O 
CBC IMG: 
Output 


NEW_NREGS: 


REGIOS: 
Common area 
Not used. 
Work area 
TALIE 


Kam Y: 


STATUS: 


Original region number being clipped off. 
MBR enclosing the region being clipped off. 
The coordinates sizes of the image. 


Intersection area to be relabeled. 


The number of new regions being generated. 


The new labeled intersection area. 


Array with character values (‘l1’ to ‘10’) to relabel 
the new created regions. 

Stack locations for the coordinates of the region 
being analvzed. | 


Logical values to mark the top address of the stack; 
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(FQ 


if top=0, then status = TAT ES 
Parameters and modes 
sed: 
rile handling 
FOR008.DAT: Output file used for debug purposes. 
Program structure 


The following steps will be accomplished bv the assign region process: 


(a) Reset the new labeled area to zero value. 


(b) Identify the intersection region to be reassigned and generate the new labeled 


image using different label values for the isolated areas. 


(c) To identifv isolated parts in the splited image, ASSREG calls in a recursive 


method to the subroutine GENTEST, which test all the boundary pixels to the 


one being analyzed, and by this procedure establishes individuality. 


(d) the results are transfered back via output parameters, and Fortran file No. 8 is 


used for debugging purposes; the MBR being analyzed will be dumped as well as 


the new labeled recion: puiier. 


i 


Exception handling 


This program issue error messages when there exist an stack overflow 


situation. 


i: 


Calling routines 


This subroutine is called by the REFINE process with the commandigeam 


assreg( !bl ime, region, isx, isy, label, rect, mew anregs 


k. 


LI 


Called routines 

Eno Test new created regions for individuality. 

POR Cor. Used to push and pop values from a local stack. 
Timing constraints 

Not observed. 

Other considerations 


None. 


24. SUBROUTINE (FORTRAN) REE E Ge 


dl. 


Functions performed 


To modify the calculated tone assigned to every node as a function of the sun 


rays incident angle over the node's surface. 
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b. Input 


ROOF Are the node 3-D vertices coordinates. 
PE COEF: Are the base plane coefficients. 
SU NANG: Values that show the sun rays direction. 
A DE NE hame oie node being analyzed. 
D Side of the stereo pair of images. 
NCHARS: Number of characters in the node s name. 
ENNA: Object coordinates for the perspective center. 
c. Output 
The calculated new tone is transfered back via mailbox. 
d. Common area 
Not used. 
e. Work area 
ALBEDO: Reflectance factor. 
EU: Source irradiance. 
ESE Radiance of a hemispherical uniform source. 
ANGOL: Acumulative Node normal azimuth. 
PETT: Acumulative Mode normal elevation. 
SANGLE: Sun azimuth. 
See VA: Sun elevation. 
BANGLE: Base normal azimuth. 
BELEVA: Base normal elevation. 
ROSSO: Node normal azimuth. 
ROSE: Node normal elevation. 
OBSANG: Observer azimuth. 
OBSELE. OBSE er elevaron: 
SONA Or, O: Sun gradient coefficients P and Q. 
RGRADE,O: RVOdC cr Cienmcochicients f and Q. 
TEMP: Temporary array used to obtain the average plane equations. 
A WRO C22: Matrix coeflicients used to get plane s normal coeficients. 
AB Plane equation coefficients. 
Sees OR: Incident angle: angle between sun direction and normal 
to the plane formed by the node vertices. 
ENTER GE: Emergent angle: angle between observer direction and 


normal to the plane formed by the node vertices. 


Sil 


(a) 


(d) 


f. Parameters and modes 
Not used. 


File handling 


(ra 


Not used. 
h. Program structure 

The following steps will be accomphshed by the reflection process: 
Work area variables are inrtialized; the sun angle and elevation are obtained from 
the sun angle direction coefficients and modified with respect to the base plane 
reference; the sun gradient ts obtained. 
Get the plane coefficients for the different vertex combination, to minimize the 
average error of the plane formed by the node’s vertices. Generate the matrix to 
calculate the coefficients and solve the coefficient equation; once solved, obtain 
the roofs angle and elevation normal to the plane; get the gradient of the node's 
normal. 
With the sun data and the normal! data, calculate the angle between the sun and 
the normal of the node's roof, if it ts less than 90 degrees. tt means TAS 
surface is being illuminated directly by the sun rays; get the observer direction, 
angle and elevation and its gradient to solve the emergent angle between the 
observer position and the normal to the node's surface normal. 
With the incident and emergent angle, calculate the tone of the surface according 
to the position of the node’s surface normal including the different effect caused 
by the incident and emergent angles. 
Transfer the parameters back to the calling program which will be sended to the 
Prolog Interpreter via mailbox: 
i. Exception handling 


This program checks for error codes generated by RSAM: check if the region 


number exceeds 200, which 1s the maximum value; provide with error messages. 


J: 


Calling routines 


This program is called by SELREG with the conimand call reflec( roo! sams 


pIncoef, sunang, nodename, Ir, nchars). 


hi 


Called routines 
CL Used to calculate the normal’s azimuth and elevation. 


DIRE To obtain direction from the sun and from observer. 
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nN 
Cn 


Timing constraints 
Not observed. 
Other considerations 


None. 


FUNCTION (FORTRAN) ’PLUMB’ 


d. 


Functions performed 


This logical function test whether a point 1s inside or outside a polvgon. 


Input 

0. 10) The test pomtecorainates. 
POLYGON: Array of vertices forming the polygon. 
INE DGES: Number of edges tn the polygon. 
Output 


iis cala | RUE. Ol Pawo. are generated for the variable PLUMB 


corresponding to the situation if the point is inside of the polygon. 


(a) 


d. 


Common area 

NOSE: 

Work area 

ASEC: If the number of intersections is odd, generate 
Moe ca vane OA RUE. otherwise- FALSE.. 

Parameters and modes 

Not used. 

File handling 

DEMON.DAT: Output file that contains all process messages. 


. Program structure 


The program is summarized in the following steps: 


This program uses pure analytic geometry to find if the point lies in the same side 


of all the lines joining the vertices of the polygon. 


I. 


Exception handling 


This program gives warning messages if the point being analvzed, lies on the 


polygon itself, or if the plumb line runs through a line joining two adjacent vertices of 


the polvgon. 
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}. Calling routines 
This program is called bv SHDPRO using the statement call plumb( NO, YO, 
POLYGONS SE Dees) 
k. Called routines 
Not used: 
I. ‘Timing constraints 
Not observed. 
m. Other considerations 


Not used 


26. SUBROUTINE (PASCAL) ’REGFILL’ 
a. Functions performed 
Filling the interior of polygons. 
b. Input 
A polygon which is represented by a sequence of coordinate pairs with the 
following form (X LY D(X? T23 T3) rere 
IA O) 
(2)1<=X1,Y1< =(MAACOL or MAXROW). 
c. Output 
A labeled image where the interior of a polygon is represented by “1” 
REFERENCE cage 2200) 
d. Common area 
Not used. 
e. Program structure 
The following steps will be accomplished by the region filling process: 
Insert anode in a list in order (Procedure Inserenade: 
Begin the Main Program. 
Open output labeled file. 
Clear edge table. 
Create a Bucket-sorted Edge Table. 
Il. Set y to the smallest y-coordinate which has an entry in the ET. 
2. Initialize the AET (Active Edge Table) to be empty. 
5, Repeat untill the AET and Else 
3.1 Merge information from ET bucket y with the AET, maintaining 


AET sort order on x. 
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End. 


3.2 Fill in desired pixel values on scan line y by using pairs of 
Reeoonuinate trom the AET. 

emo re rom the ABV these entices tor which y = max. 

S-emeiecacn entity remaining, im AE, replace x by x + I'm. 
Da plees the next scan ine intersection into each entry 
umbe AET. 

SORE onthe AET based on X-min. 


arenen y by 1. 


While step 3. Print out the labeled picture. 


GQ 


Calling Routines: 
SERRE: Select regions intersecting with the projected node. 
SEIDPRO: Shadow processing module. 
Exception handling 

Not used. 


. Timing constraints 


Not observed. 
Other considerations 


None. 


ANAANAAN 


naa DO: 20-0 naa na 


GAO 


aaa 


APPENDS 
PROGRAM! REFLEC 


October 15, 1986 


subroutine reflec(roof,tone,plncoef,sunang,nodename lr, 
È nchars). 


-h,o-z),integer(i-n) 

] | 3) ,plncoef(4),sunang(3),temp(3,3) 
dimension expx „EXPY (2) T 6Xp2( 2) 

inceger Cone 


character*8 nodename 


implicit UN 
dimension Rea 


data expx(1),expx(2)/-2693765.9,-2695594.2/ 
data expy(1),expy(2)/-4304520.4,-4303718.9/ 
data exp2(1), exp2t2)/+38590183,+38 58545507 


WOK area iñitialization 


pi=4.0*datan(one) 

albe do IA 
source irradiance e0 

Silo. | . 
uniform hemispherical source irradiance es 

es=58.82 

angtot=0.0 

eletot=0.0 


obtain the sun angle and elevation 
call direct(sangle,seleva,sunang(1),sunang(2),sunang(3)) 
get the sun direction with reference to the base plane 
call angel(bangle,beleva,plncoef(1),plncoef(2),plncoef(3)) 
sangle=sangle+bangle 
seleva=selevatbeleva 
if(sangle.gt.(2.*p1))sangle=sangle-(2.*pi) 
calculation of the sun gradient 


o oe salare I ee 
sgradq=-1.0*dcos(sangle)*(1./dtan(seleva 


get all the plane coefficients for different roof 
vertex combinations. 


do 1=1,4 
do J3 
do k = to 
J173t1-1 as: 
12(3].9t.4)]]=33-4 
compl), k)=r00£133,k) 
enddo | k 
enddo | j 


get matrix calculation parameters 


all=temp(2,2)-temp(1,2) 
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ann aaa AAA aanaa aaaa aaa aaa aaa Anan 


anna 


A E eS temp 
a21=temp(3,2)-temp 
az Z—EeMp Goes temp 
DI? Stemp 2 Cemp 
p22- ceno o 1) - tenp 
b11=a12 
b21=a22 
c11=b12 
c21=b22 
cl2=all 
c22=a21 


a A a A 
KF LID 


get the coefficients of the roof under consideration 
a=all*a22-a21*a12 
b=b11*b22-b21*b12 
@-G117CZ22-E217%C12 
get the angle and elevation of the roof 
call angel(rofang,rofele,a,b,c) 
angtot=angtot+rotang 
eletot eletotirofele 
enddo ] 1 
average normal to roof angle and elevation 


angtot=angtot/4. 
eletot=eletot/4. 


gradient of the roof 


E Seo 
rgradg=-1.0%*dcos(angtot)*(1./dtan(eletot 


calculation of the angle incident I between the 
sun and the normal to the roof 


dnum=1.0+sgradp*rgradptsgradq*rgradq 
denol=dsqrt(1.Drsgradptt2+sgradg**2) 
deno2=dsqrt(1.0+rgradp**2+rgradq**2 

a dacos(ónum/ (denolédeno2)] 


che ancrdentrangle Is greater than 90 degrees, then 
smemmeade” ts not directly illuminated by the sun rays 


ur unnor.gi.(pi/2.0))return 
caleta trono the emergente angle E between the 
exposure station and the normal to the roof 

call direct(obsang,obsele,expx(lr),expy(lr),expz(lr)) 
get observer gradient 


o a) 
ogradg=-1.0*dcos(obsang)*(1./dtan(obsele 


qee angle E 
dnum=1.0+ogradp*rgradptograda*rgrad 
denol=dsqr (1 -DrogradbtXitogradg 22) 


denez—cdsore(l.O0rrqradp<*2trgradq**2 
emerge=dacos(dnum/ (denol*deno2) ) 


Calculation of the new tone for the node 


Dai 


aaa 


AANANNANANNANANANA naa 


nan 


nan 





calculating the new tone for the roof 
a a ae ee nese 
c*dcos(sunnor)+es*albedo*((1.+dcos(emerge))/2.) 
tone=jidint(smc) 
loading the information in the facts table 
open(unit=9,file='newton.dat',status='new' ) 
a oe 
write(9,910)nodename,nodename i 
900 format(' smc_tone(m’ ~a<nchars> enne 
910 format(' smc(',a<nchars>,' m' a<nenarce = ae 
Close mcs) 
return 
end i 
subroutine angel(angulo,elevat,a,b,c) 
to obtain the normal direction of a surface 


implicit real*8(a-h,0-2),integer*4(i-n) 
pi=4.0*datan(one) 
RR E cool 
90 1f(a.ne.0.0)90 to 100 
angulo=0.0 
domo oy 
100 ani 
150 ift a.le.0.0).and.(b.ge.0.0))angulo=pi-angulo 
(3:96 10.0) ang. (B.16.0 
0 
/ 





1 anga o 

fla. ge .0.0).ananitale- 0. angulo=2.0*p1-angulo 
elevat=pi/2.0-dabs(datan(c/(dabs(dcos(angulo)*a)))) 
i 

en 


subroutine direct(angulo,elevat,a,b,c) 
to obtain a direction given a single coordinate 


implicit real*8(a-h,o-z),integer*4(i-n) 
pi=4.0*datan(one 
angulo=datan(b/a)+p1 
elevat=dabs(datan(c/(dabs(dsqrt(a**2+b**2))))) 
coun 

en 


98 


10. 


n. 


PD TORRE FERENCES 


Brooks RA Greiner, R 
116 


, and Binford, T.O., “The ACRONYM Model-Based 
Vision Systems,” Proc. IJCAÍ-79, pp. 


9, 105-113, 1979. 


Rosenthal, D.A., An nagie Driven Computer Vision System Based on Baci and 
Conceptual Hierarchies, PhD. Thesis, University of Pennsylvania, 19 


all Ao Evian les Feldman. An eo to Knowledge- 
Directed Image Analysis,” Proc. IJCAI-77, pp. 664-870, | 


Matsuvama, Nagao M., Ikeda, T., and Ikeda, Y., “Region Extraction and Shape 
Analysis of Aerial Photographs,” Proc. IGE R-78, pp. 520 0-625, 1973. 


Pce MA, bemenbaumewem., and Wol H.C., “Detection of Roads and 
Linear Structures in Low- Resolution Aerial Imagery Using a_ Multisource 
Knowledge o Technique,” Computer Graphics and Image Processing 15, 


pp. 201-223, 1 


Faugueras, O.D. and Price, K.E.. “Semantic descriptions of Aerial Images Using 
Stochastic Labelling, Proc. ICJPR-80, Paoa, 1980. 


Chien, Yi-Tzuu and Liebowitz. Jay ae Systems in the SD Environment, 
Computer Magazine, pp. 115-122, Fly 19 


Mark J. Carlotto, Victor T. Tom, Paul W. Baim, and Richard A. Upton, 
“Knowledge-Based Multi-spectral image classification,” The Analytic Sciences 
Corporation, 1 Jacob Way, Reading, Mass. 01867. 


Gol@bero,.1., Karam, G., Bue Alvo, M., “A Production Rule-Based expert 
system for SI! multi- temporal Landsat imagery, 
CH1891-1/83/0000/0077, Eee oye Yate ly es 


Se June Hong, “Guest Editor’s Introduction,” Computer Magazine, pp. 12-15, 
July 1986. 


Nevatia, Ramakant and Price, Keith, “Locating, Structures in aerial 
photographs,” Imaging Processing Institute, University of Southern California. 


So, la: G. and pet Fennen R Jr., An Objects under different 
conditi An of erial Image Understanding,” 
CH 1595: 8) '§ 1/0000; 0470, ERES pp. 4TO- 471, 1981. 


Selfridge, Peter G. and Sloan, Kenneth R. Jr., “Reasor a 
failure -ip aerial image understanding,” 82CH1761-6/52,0000; 


out success and 
044, IEEE, pp. 


99 


14. 


16. 


A 


l5. 


19. 


20. 


Mekeown, David M. Jr. and Pane, John F., “Alignment and Connection_of 
Fragmented Linear Features in Aerial Imagery,” CH2143-1/83/0000/ 005 oe TEED 


pp. 55-56, 1985. 


Moffitt, Francis H. and Mikhail, Edward M., Photogrammetry, Third Edition, 
chapters orandi? 


Zea a Nen E Hu Chiu. and Tsai-Chia Chou “A simplified method for 
matching sed planar scenes to reference scenes in a DIS 
CH1891- 1183 ‘000010366. IEEE, pp. 306-507 15/55 


Robert di Woodham “A computational vision approach to remote sensing,” 
CH21#5-1/53;0000/00GZ, TE EE, pp. 2-ll ss. 


Smith, Graham, B.. “The relationship_ between image irradiance and surface 
orientation,” CH189/-1,83/0000,00/4, IEEE, pp. 14-18, 1983. 


Ballard, D.H. and Sabbah, D., “Detecting Dda Orientation from Surface 
Normals,” CH1595-8/81/0000/0063, IEEE, pp. 63 I. 


Foley, J.D. and Van Dam, A., Fundamentals of Interactive Computer Graphics, 
Addition-Wesley Publishing Company, pp. 457-460, 1982. 


100 


f 


y 


Us 


are pistaeurion LIST 


Defense Technical Information Center 
Cameron Station 
Alexandria, Virginia 22301-6145 


Librarv, Code 0142 
Naval Postgraduate School | 
Monterey, California 93943-5002 


Professor Chin-Hwa Lee 

Code 62 Le 

Computer and Electrical Eng. Dept. 
Naval Postgraduate School ~ 
Monterey, California 93943 


Professor Charles W. Therrien. 
Code 62? Ti 

Computer and Electrical Eng. Dept. 
Naval Postgraduate School 
Monterey, California 93943 


Direccion de Educacion 
Enmmera Zona Naval 
Guavaquil-Ecuador 


Office of the Naval Attache 
Embassv of Ecuador 

29 5th. S N.W. 
Washington D.C. 20009 


Monterey, OA 93940 


LTJG Carlos Vallejo 
SNI 2373. Naval ostgraduate School 


Monterey, ‘California 93943 


101 


wo Copies 
2 


Cri 




































+ 
s . 
` > La 
? 
> 
> Y E 
5 ` 
a A 
n i e 
« 
F A 
È n e 
s a? P e n 
P 
e » Li lei # z e 
m Le = * a i s a 
* a si 
= 7 A A f > 
Ùi d - P 1 - . e 
hr Pina ud 
LI Sa hd sg Li . e Ld 
a .» = = ai e 
- = Li 
E g 
rs. a Di a Fai ua j a 
m Py e > m 
Pi "i Fi wer 
ti # ” s 
r P 
s ra la E A 
e » e = a e r 
ne © E L A A 
? $ e fu a « w d 3 = 
a e a A è = i 
i P cd r A e E È si = a y 
Leti LS a 
a na # 7. e e y P r Li 
È e oe A Pi = ye A A Pe Lai A 7 Pad A z m di a » 
Ps e y O A no PS I n ta da pa SS = > A A A 
= ii - = bea a y r >? = ai Pa # > 
a A > me a A ut ” » f ” e pa X > al ha 
E 
P = ; $ a e d A pe» Y v r Fx y r r 
n » e r a 
vie : > a e A pa é 4 ETA e p ae P © #2 Gi , oe ae tied - a! 
ic ds a Me E E a a 4 i > re E è r a x y E a al 
is oe v | * . d vr io rhe é d r se 
$ a A Te x ce Fis Ps P 7 e a oi 
n° e PE bo ai > = 5 z Ellis E TI ro. , e r a a A » > e i VÀ 
+ $ P t = 2a Ae e or + e £ LI m4 LI Da > + æ mos > P ~ r 
— pa G n va Le ? o_o [ili ee CE A E we po aed P Er 
A a s e a f s E 2 y T Cd AS e PI w A, pe 
4 T = 7 dI * at al * Pf Mia . ue P , è hy & > A 
_—_———— — È Ta ae al N * + i ” ir ~ d + ng e è er PAT pr e 
— = WM de o A è rr e + m 3 ‘ r y e or > A A Pi 
= : A Ci 7 % f 
— pa è e = ` e + qa » k à E y s A = A > i E a t y s - A - P a = a E e È. to 
—e—___— zs as is = d si E 4 di A a $ $ a . a 
== > n vitara Hi a a, , a s x ii a : È fà een pf te iw = apt A 
r—— O) CC A A ee + A = p =, A kia I Pr = G Dall al a ” Fal, f a e -- ya per pd ri e sb A 
= ~ <L Pa de + e a al CE ai = E Li Fr ll Pai ia r rey Ca È ” ~r PA rr y rr cab ga 
——. | an we S hi n x N t A g 2 la ahaha s eT a pr, Pe oia qa E + 
Á CC È y AS A + 2 A a m N 7 es Ey Pos path! OC” ia sell I alia ans ” 7 a Y RE T > q A . 
7 , E = J > Pept) r - 
——— de) CO ` ar pa A a o i aed q s a d cf LP do i as xf E d PEEPS OPPS I LOO PDA 
= — “E à o fi - 4, « m ta = Le — La) - : de y tg wy Penali SIL Patata SIR E _ A E a e 
: = pa ps pb e q, < = b Lt = 2 y ae ud LI Fr LI Wta Ty y y TE A A aid 4 sg n y 
j A 7 N ta T ` ~ 1 Ù x AA da A ae aa a 3 A E E d: ad AAA ra Pye oe > 
= >x< a p Bn fa A or > a * a t a a a Fala ya # a 1 # > r a py = n a MY ahah on. ol af os on wry a a + Ed AI 5 P 
=== O Es St a © È s G aah % be n A x LI - i = | a € pu : = 3 ” È ya y a ALS Mb a PU IR ao om a ir, PESE è E 
== O n SX g i fe ry di # de y ¿DP PO , $ K Pa F an > b . a È P p 
et O . Ays ka ba e a 3 13% è a A car, a ted nr hi Li = A pu PA ya y- ug le iat E A Ka = tale to Lobos, a e y ae gf» Cat Ss o 
Pra A y % EROI y i S uty a 7 QA, Y "=. ¿A A ' la J ESF , A E de yo a P paian s gt a paom PPM ep Oe > è < 
— = © x A PRA aes AI AAA «e SF; i e i ode PILA pnt gl A Li PA TE sish Adept “ uit) RA ¿A AA ha E Pi O a Ea - 
, cer pi -ey A is a : s i alli MA: y a e e et gif I ah srl pt reta a PASADA ae oe OPO LLP INEM GPL LPP I OF SFP PP PEE REPS we m - 
— > > e DN q id pa. ue G. cli nt rt PA pe di i È nda aa oi gen : Ae e MAS alt PAS : A A he a - 
= CO È pi 23% 2 <q “» quis - k ua ve pu mue ao » + Lex n Tied td g di p Cr d see sc i lla > p , È CAPS NA + A 2 a Fr ree OT et i ot i k d -.. y 
—= LL È Pet ae a E LAAR a T lay ~ TI R ds tp dap alia A weg bap : L e = pd ra i ni. ah idia r ES rY Ee a e aA a CAE AEE ai JAS 
= LO j dd È; A IO rs as 4% ons oh al nta RE ANY ==. = A pa lll Dipti Rag. ches [| y A O E rt e dd al AR IA ZA de PE ra A a oes te. nd PETEA- 
— Pt & EES Sr Sale HAS TH EWS TH UES TD ORY SG nage ei pg pe pi 54 piedini gici pila ‘Alba a - as Ra Sep INI kag ER dat AU e AAA AA DA AAA AA PL PELATI TT 7. . Past 
m ~ O be AAA ES da de gaia II do A Fn fact o le q tb: pr GAM pan path lala E A graf bt reti Ai I fig e e ia oo e VA AAA ST TI TT ES eT PY pig PRA pag Pig ee po. a Es 
== = hr hu rn RR La ew ES > NET ARAS POR o ri A > Pl ON eee ae Le Li Sr adi db. pato Sen AIR Se Pee edited ax Dt dde AR AA A AO CA A a bl PEA ES gie se~ Pro 
- 5 CN TR Ai E A i e i ii n e QUA AA e A qua Sapri x +4" ni RE ll a > Ao apt <= A ra MA DASS AAA AS A, A AAA AE A A Vea pren da 
Ga se O bs o ADA ERA A Di AN Oat O ia NE AEREA AA ala as “ n mue e raur Er ari mE Ap E aef eoe A Ae AA Sd A IA AAA AOS e RT EA hah an fel PBI A AR PARA eee os 
+ —— CO è me a ba A OR o ma qa Y AAA a da, A, Sekt AAA ANNA AS lt pi Ae A Li Rai AAA iis ei E A A AA E AAA ARA Ae PTA PUEDAS Pe ene, ag pa 
00 : = pao qn Mh ae: pie ARA ge oe bh wo Was ae o le nc e sra - A A Dl cl ln a Bossi su da ry Me Ad d Parar SEE A E EDAD AS AAA CAC AS PELI SSL ee te; Sa ARS, 
- CU e AS | Ys ae > ee ety cay oe) Pd Tb de a) TALI Art tle be me lhe E i + = Ae AS be held rd A LS A rep. s si dal: pu vy oa pa e P < vdd dE < È 4 E a 
e = Pek ee = ha E n paid Apa P > ot Re PA = p wae pt va as oF PA 5 es o a Jada oe rre! ad on Pie al yO ATH dd dd io rye’ POTS “dt Sl Ae i Ai o A gat cla i AA bo Fo e + SA fe math he ft ce ae at nt dell hag. 
D — ear a o veg O WES EET VSS. TA LIA O A ia A gc LE Ca A li ld i i AA AAA AAA sil ln Dj FFX PEL IPR LPC LS LF LE LE PE eee weet- i rl gi a a oe er e ARE 
u — — L na A ad ere A the g w n O a AA Ls 5 bi TA e LIA ANA A 7 r a Ma a ic dde e AA a a da iid PA E E m AAA A Peor blip Gt ia ic aii SH gh do Et La Pat 
— = al J y - 4 s > a Y ed “ ee > 0d r op > ` P a po a = A u bl 4 x a 3 g g. Ka g 
£ pr AA A o dci o pita oir dal a A pS Side bun. ele lenin ri fps t laake piap in pp 6 A A a paLa a E PRIZE E ADA AIDA A SPER ateka EI eds 
gene y Dí < A n T aa ta) I T ad 7 Ll nd ada y J aed la cas LA AI k jors iai G adi . y. = pa = È r air n we 9 a ha 
ep tat  S PAT Kuala dd pl ln ew he isp gt È ON rer cr nl, A a a A E iS sf po mn be y pa i or tà a y & plani Pr sede a Aid de") il anal PUL OCT OWN T KK al do A CHI (Za ili dai die AA IL Y ida EPPS i e 
A Que AR A A di tele BO A AA a Lee ie i aim - Nr vr A AO Apdo Alto es eros a th Di chia d dd el A od TA A A Mirri Mme Fia aa Adina A dd a PPP ORO LPH: 
pra bald RAS RS ias ho y pl Ii o PA i Lae oie IN dl ici dole ra carrara aii LS a la ALLA pe Ao EA A A E, dnd ato E AA PA A ASA AAA E TARA A A 
ma — ie Ht RI ie OTO Scià Solare verrete. Cato A A A cs AUS Pt ih sa Med da db A ar ihe A Ai A ds die Py r LOA GON FL EP PLO A ROLLE SIG FO GFL OOS ENE. FOP TOL PPTL Sat RE rana rs wey r >> (aa 
A ee pi AA a" aba RARA A Sd ls ii AE a id pd fir alia n i e i pl pd, MUI eye so blo do ek bn x Sele ii aah ai AA A E E AA AAA SRE REE PS FELON GOCE OLE OTE PLT RRS PAP LS OPES PED TPE LER 
¡QUA re aep Dea È pet a a AA AAA NA ae a ST Ti abi ARI e a e a Aci =. G ae 7 A ERARE di dde ri ao AA A A ió A A AAA MESETA TA A ed sgh fife. PPL PERE EIS ARA be la lindo dl 
ate A RT: Fo lo dee dera o LS AAA E y de A A a De i a a AS Taali Tias o e 7° uo de ed rr ar A A A AO iO Ad IA AA A A AÑ RS Re A A AA AAA e ope ; A hl 
A a ada i IT dl lay Bde fe da AS NN RS ato pipi E ery Pye OVOP ITE A OT UE r RE I VORO LI CEC POAT ERE N TAER Raff PE ATI PARADAS AA AA lm 0h ist hts ae A AAA 
yaa eat ie hate PN Shee testy id tho Shae fa) ts oly e y ao Yá - aid ely ete. dedi ibi aed Dr ICE a i A i Tare S ao ae ad AA ci x A a ALA AA E dul eS tae ha ac Pi apra is fd © li eg RT Eds. a AA AAA i vr otha th gl do AB ces pate 
AA Te GE AR TA dd ON hd A par > a e Re Y ae a A AA vev a PHP OT A E arpi Ry Tm CA > = Id > rick Raiano bin ds Pl LEAL al tdo A ar E ES DAA » 
TRA A a AS Aia a ai ga o e ig e Po a A rr ii y a A RIA e A or AA ra ns di ELLE: Bee AES A db dE het AMAS adds dba ra LR 
) È ar Ax Ei y ; th bt dad Ve r j È “i > pra h 7 ro 1 B i Aid pA = wr Pe A fat A e 
Pole A NA e x OS Ml i Qe Kad tin Ee Vai eae te? ee SC coh teak he be A SEY TS YS Gee y ea A de rn ls x v (did Ae i A Al id cado LA yuan Lo A A ti A e e DE HA A ol A VET O rw © Sista adil Aled ngi. > Sit ta A RABY Bap fT 
ARA O OO Y se ty St EN a tit eB Rh Sate fk bye ik Boil oa ol lin dh finds Be ht tally A an ae o A aio Lin NTO doc EA irc o AB O A AR ADA Pe Eee Lee teem ea ee Lae e A e DARL IO Lr pia LTT 
a Smee Aiai raa Et he th ta id q a ey E e AA A AMA ae ppc tc A ili ade: A dd pit ies A A A AAA A A prep EGSA tte el Mera ff Sethe GR AR i iA aim pa A EA ia 
RN NDR MI o e i pioli lr ne Lc MTA Ap e PI SONIA CORNER PERSI RO np I PE LORP LLL SP POW DPI OP EI ER COL OPPS LIOTTA AA ga OE LAREN 
A S y È era 7 p È Pa cd E E mP Ù d y f 4 a 
IO e e o ie Pa de a F rere PRE PE PO ELIT LIP OLN oe phn ted aah, Mh at tl ate he jc a 
Pm : PY 








A YS STS AAA 
cas a A ea pae a Y aN o ANA ad ri A A la latadts paid pd dd 
h peo Mira ARTI peri y A A do La PAD A T a i oh ie ek Sp = yA ile A de oy iit des 4 ascites Ao seal gent ny ed tod hole a Pe yl ae! AWE ld Rae ti ai, Era De tti pS A 
TEN a ae A MAA AAA dd AA AA MS lo de MIDI UI o” AS Dl j td A id ii A SN Aa : italioti PEGG EERE OT ILE OE OPT A ERE CPS PP aa A q e 
A Da Dal ha a lie la DA dd ee CA È cadi x "a Li pi? va Sedi th + seni AA es A o A A ATA A LA Fd ala ILE ARL DL AA VE rina fi = SAI LAI i ri ara ide pia pa PARA AAA taria, e es Lal Errante UA AC bk ie 
k pic qa ua ES o de ii a A li y > pedi a A O acl pata dadi pa Ga a ear pit <y E A AA o do id AS AECID DIA LS 
mp o aca ROS AAA ai pc a le a dd hara q ba pg ph ip LA a da a Did Al oi A e IA gigi dp nr ih ao il AAA e pr ads SAR Gee ODS Ot IE an fannie 
GR > E y pS e S % Lc Y OEA ADA aa IRMA NOS ae a y a sa Y i Led ENI ERE illo mim FAA AAA Wi SS A IO AA AE AS AA AAA de IA BILE DAL DEAE 
A Tae ete! è >” bra rude hs i è A Pra y rd A A Da iii ti NI tell AI A ATI tes LI e a ORI SIL SARAI MIRA i A e DP e a hik E Pai 
A A O e pic o ae ng na dt atriale pine] Ali La LE sp di n ene ATA ed pl MOE: oa 5 Pte iii pat oe fh ad A ASA AS AJA 

at ak] a y Ara pre i È = a É 4 rw b 
a Dr sete le qe EN PTET AE ES AS AD AO EA RA AAA a a Ht pat i Lot 
x PAT TTI AA Op re arri Lee rl Aid er da ME t papiga 
E A AAA A A A AR AAA a RAR PRAIA SS 

























AA A a lcd o li 
f A a re ade erar OATS rE 


PO papa E CAAT UN CUED 


E Ad e qua dali - ara 
A A Sh ta Set I ; A 

PA A AA aa la dd ad: bd e eii gr 
AA EEA Py CV Ne Aen hy pete Dele del Sal AA E A FECTS TLV OO PY 


> acia as dd 


































msm Sa iad 
A SAO, A NAAA AAN = si 
pr: R ey A et A da a ee! ete tn a Do DA o tó A f 

pod A O AS a nr A o o A cd ES gi AA A DI GAIA Te EA AA add E A DALIA ARAS Satis 
A - da a to A A A IA rl de pey en, A 2 Je fp he j ai oral 3 > CAL A DE pr y PN e AA A oida ; PPIP F 4 
na A EAS A a FAA AIR laa rec to ol Miei i Didi RE pace IIA lt ci ARA A tr ante RA Mis SPIES A AAA nd pS dre ELON a 
di gd y dd ae ny x VADA VE di ra DARAN E ADO dh it A ly EER RAE ATE a le o ct e pl ill ti ad A A A prada dar io Al e AA AAA ANSIA NA AID SRI SIETE Lr sea fifa ee 

A A pria SA Ed da od dd RA ad! vt ANAYA SN ro elec dr: ps oy diia os» aa Lula. prin Si a N RI dacia dt, Bi ig y e ¿IIA ACT ANA ICA PT Pt PPE er PS OLAS TT IT SoU mA ALAR EMAL MAAS Rat Aoi Ried aes a 
OS da alada 0 ANNAN A o a da ES a re YO SAA Y e AAN A A A aid dt A pelar ll Si aD HOP TPG TIPE MTG TL A fe eee OE A A E AEREA AA bn Ir sde te, 
; AR aa bs. Ria ii PA RAN N TEE rta UNS ia nie quad na pe wee ye A A A ad ¿RAS AULAS E ys” PARAS EA AAA AAA AA AAA paja fh ons Pf hp LE an a 
DARA A TE DA IATA E IA GATE ATIENDA VS Ln RCA AI Lie eai BPEL ALIFE LOOP AAA OR ADIÓS PF OER OE IE LY PUP ES EDO I erry PEAS E Ps 
AA A O A AR A ia do palio AO A E AAA AAA AAA AE AE A AA mimi mig hi AA ra > Pelt a 
: hte Bd 


i ea o ~ pea Se ae 
A AA di A! qe AAA A A 


A a e T de dd ds ds Bai, x a ur ve eg Pe 
IO 1 O AAN IE UNE vtr fol Li id b ASES lr ALA HH EY HES e dba de à A 
E A E ALA de MOTTO Dal AAA AAA A A e ea hal a ARA re RADA AAA è 


robada ii A Le dic 
JINETE OIE i Y O PRIISTA A A EE 


a a Ls o dl e A al AA 





A a a A e ah at kde tele de il Ba AT a Bal he al 











MA ad. ld do ai ol A A dut a y > 
oth Pa I pita a AL el ; A on de A AA A A AO TR ad AA LID puote tr s ; a 
Ak is ad 9 do ! “i a O ARI ARA RA en Vi A The opp atl a ARG Fa te ACIERTA O NON mr a i OTe era oan pal leat Ae 7 
nd È, y e Ma ro A re E ast ter ads Li oad s wa hd IAS a A a de a Tr dA pe vn Wy A Te A E a it di TA #20 FPS WP FT AT f. y 
det SA eee ele See OAc Mg ALII RI ME AI id A titi IT EPIA EOS: ap AA A pri peda se rá ra rare casi 
A A AS AAA ARA CAE AAA AAA fad hat ile A (PPO PIT CPL CEL IC PEL IE POI T Ji pet 










ah eh | wig rk ALES A + 
Mid pa de e: 5 E a PA Ag 
AAA heli t a ka Sh a cb, ple pue a yo dardo Ardo iy DA MO A 
ao a MV "A a PR Alli A E LAI ZIA Lc AL A Aida 
EE SATA AIDA CARA ASADA p A 
acA Ala A q ; ir 




















ett mali 
AAA y dy ed NTD a RI i OA a iai a aS a 4 
A ap a dl ean atin dr RO a py yd si A tats tpl VALI Pa pl a ceti bite pet = $ z dana A 
rd de ia Asinan S ada A A aed nm A a yi: Ng VAI > 12 A paria. i NA A a ERI PISA DA bre ait ca de tear i eet ary e v preti ii. rs EN > od dia Beh ty fa mod alare tl: or e SICA ATRAER 
; TET ? ; rr APA PRS A la a e uta a mi a Cane td der ad arte aba de ln ojo tl Mala ASI Po o ME PEPATI ST e STI hind hl ANDA ETA AAA FS EAS 
x FE AORN ATO EA A a AA o a Dira re ein ili jar Md da Api oe PPEIWPY EPA AA AA oe Ah AE ol ress AEP Rak FE 
re A AA FP ST OT FV ESOS EO PS FORD LINE EL PHO TF TOES eT rR APRA LAPP A LOL GS OLLIE PLP FOG 


VAL ali at dalia Oe E AAA aba a Lai dai er ne aan 

LU E Sa Os a Ya Foà pi A Au AE Moe pas RAR AMA AS AA Ll 

A A = ON ily Diodi ey He e Rari o ea rr AA rin KaL ia aiee papii parasal action sepa PAPE Naat aw oe 
aa ALGAIDA Bah Ne cee i A O IMA a A dei lei pie eS AA AA PLT IA DA AER AA Lil e s 

plat Ai te A O OS AAA E AA de aA A AE A ES IY ATLAS 

RE EDI ADA A AAA AR 


as e ld h o ea o è ru tad 
ra. AUT PEEL o ad dd a ADA ag sa CY Be as Pha a a a aada tin ek peppe netv ere? DCS: alar id 
Ao ALE Pg para ATT ATRAS ARA ASEGRA A AMABA ll BAN TRI ii 
LVS USS ITI F aoe OTE EEE AED Te het AAA E AAA A Adai 

















A ONO Ad a laa de = È re r- 
SA QU A A A ARA hel ys al A rps, dha 4 A 1 I TUTO e aer POI at de a 

Ei e des si edita a lacie drei Siti TOA IIA APE EL FLP 
(4Y T 








| ) TTT: A aa Pr a 
a PO hb e td Da shin tle Eo ES ee Th A G PA A Aaa ld Mbt a bal r : ae das de fry s rere dd AAA 
ARE bee ds ati ii lies dr ARERR bi ted At DECE AAY E e sat FOr EES ILA f peri. 9° pry er To A betel Ie hse aida de Do ied, ia A PA ESE SERA EIA IAEA A AAA AA i i 
os v EOR py ytan ; o I cbr da A a ds A AAA AAA ANA IS Cider dud jn ee bes noie e A a 
e Frari i de RT a) fo TR ITA ei IAT AN A I ip A id AA DNA s api oi ads z Pa A fees re 
F kaira aora pa apta ii a i acli phantom Lt i A IAEA E AA Lei ddr » £ 2 
qee, «ar A 4 io > Taa PANE WRAP yore? is a SYST’ dpi DI i a LI N Na ai di IPAPER A a PITA POO D en > "tag A : s 
oT ds ds a D, ice ia! AL aihio A! A LA Ai ORES BEDS AME eae panne g ia pas ting Lario dt ALBA RA set App Gab fi È nd 
AIR AAA se tee eS Oe hab hed NE it VI Gia Stk al Sh AA reo ua da pe la ad O ana E T MU hl ach oh ech ll he Ah ala ll i Ada el AAA ti Ri li AES SA RRL lok E LLG RS A A hab tas papiri Lf iets 
She ESTE TCE PS AN RT EIA SIAE LT TATO A re tro i ated noe ee PPLE LAL Ah phe alt al eh gn Sk AAD bP EBACE ALLS EEA LB 
» y k E TITO, Ci ata la i ia BAL TE eN eya e Apio Wr | el AA A a A a Pi ih hatte ii r < n eta ip LL paci Ji ra. TIPI HEAR II GLI It) a i > 
poe Shoe a eh x a a Bal isiua pda SA n > A A To do sie esa > la! be rc E Erie wr G sb Pinta alo nts SA SIA taba aes tm as see Les pei da sf aed Site n a gana A AE AA x (all = ca ARSA AR Pit ste, ad gig Ap = z de fr 
A pl A MILE TA JA o AS FRETTA VITA dee Vai dl sarta A! RE Nerd “eda li sk sell ver ye CPU NESS y a x i ri aih AAA iA TS de E A A ASIA AAA š ) va aree Adie IAS a 
NS YAIR Sa al An dc A ado: a) dna CRE AAT Ae si NA ben ii i Ci Aca tg de ets cll SAA A id ad 0d Fe Rapes Ale Ph putin desert fant yay Fore Vaca par ee rere PA Add pd gil At LAMA det MA 
AS AD riale lun tal er Ah par espana lie Lia a pa et A eat aaa A A a dr BR RAL LI ER RANES RIERA SIS TERR pi E AS 
NN O a an Aa Aa tae na AIR IRA AAA AI AE ATA De O NS aD e da roma ee ANSSET EA AAA RRA ARA oe 
AAA SA A de Nib ab ah Oe eh oe oe MA Pa A o NAAA na araya TORA be dy y ep nh be Sd reset E iO ia e dl a ii a fe gf hi LUCIA MSA Lat ds oo IL PAE UY FP POPE EER OS PIL TOO OT PLP PPR. AELDES 
AN RS ENT re A EA II O A A A a Ae api i AS A A A A II A E SAA AA et cid a ALISTE TATI RAEE ERA e 
AA ANA ibid A ra cali re A AL LA y Apra a i e A AN dr A A e perito citan Ia dai hal iio PAS Lh Pati ng: E PIWA IOR NADER rI D LT hd thd lee EPA RS 
EAN AA TR sa A e Didi ADAN fan i E LA dei o ul oi, rad id 8 oe Le id ath Be per, pray di ARA DA T TPE PV ECVE LT EPI EDT ey COMPRI PETE PIE All di RA î 
N > cM Oe ae RL a ia one ih ih alc thao A AN A Erba oa ah lieth tie leg A AAA TA if e A hth ad ih i J dalle arn de CA VA IPO A AA ID AAA e at A AAA ADS : è Ks 
DN LA A CA Sad a ae gi PRA Men a Per ire n o pre pepi Ai het AS Pro pero hi pia hdc as a de nea hf AAA CRA deh dig e Ae TRE ALIAS end CAE nn tic 
AAA AA ' AA AA a ur clado Loi do il tsa = 2 y ELE TAIANA Dm a a E A I I AA AA AAA AAA AS war. EE LS: 
qua mente o Ad FEY AAR Ae A AAA ide ppt holla Se ad he fas Kha nish dt telecine De MD CP GDA e Pid SII A ii AA A E RE. if i, AA TA És 
EE ESTA y hy AA A E a e TRAI aaa alri A a Gi Ta ala AL 2b. TEO pr 1 Ate eb AAA dal wea PSA RRS DO da a Aa i mio pa ibs ELA by op adem asap so | AOE abd f e 
po re y J A et thi a A er AN Ce Ge ASA A A in Mares UA pi Al A OE a A ENF PPE EATEN TT OE DIET PSE TTT EE? FT: ES LITTLE A IAS [Ada pre ee pt es sg RF: 
A e IN NA E RIA pa aye) OPS TE pr ¿PAD IA RS CAES AAA Riad ppt ti SLOAN LETS EAS 
AA AAA AAA AS IT AAA sd È ed [A al » AAN Ae Ep ELIANA RS LA 19 3 PLATS 
Aa Y o " ” li MELE dt Acli di A AMP & po Pt 


peu: Cd 






TES rarae a sa se rpa a e E a T o. ld 

ad AA A da : 

TIE S 

Pie Cote 
eae ARTI VOI VW 

A US A E Ka ii x A A Me fede on i o a AA A: 




























O I ok Ah ied ial Det mies Eh Pees te i ls Attala thas AR LI 


Hagges ths Nr ath Ay e 
A e ya e Page | RETTA Ta lidia hie 











a EA A 











RITI an (A i: Adi dl 





di =. 


